-A127  460 


BAVR  -  A  DATA  ASSOCIATION  ALGORITHM  BASED  ON  A  BAVESIAN 
RECURSIONS)  NAVAL  OCEAN  SYSTEMS  CENTER  SAN  DIEGO  CA 
H  J  SHENSR  15  NOV  82  NOSC/TR-848 


i/1 


UNCLASSIFIED 


F/G  li/1  NL 


MICROCOPY  RESOLUTION  TEST  CHART 

NATIONAL  BUREAU  OF  STANDARDS- 1963-A 


NOSC  TR  848 


i 

%• 


Technical  Report  848 

BAYR-A  DATA  ASSOCIATION  ALGORITHM 
BASED  ON  A  BAYESIAN  RECURSION 


ev» 

tH 

<! 


* 


4 


M.  J.  Shensa 

15  November  1982 

Final  Report:  October  1981-September  1982 

Prepared  for 
Naval  Sea  Systems  Command 


Approved  for  public  release;  distribution  unlimited 


DTIC 

ELECTS 
APRS  91983 


NAVAL  OCEAN  SYSTEMS  CENTER 

San  Diego,  California  92 1 52 

88  04  29  048 


NOSC  TR  848 


AN  ACTIVITY  OF  THE  NAVAL  MATERIAL  COMMAND 


JM  PATTON,  CAPT,  USN 

Commander 


HL  BLOOD 

Technical  Director 


ADMINISTRATIVE  INFORMATION 

Work  for  this  report  was  performed  from  October  1981  to  September  1982  under 
NAVSEA  funds  —  Element  62633N; Project  F33341  ;Task  Area  SF3334 1401 ;  Work  Unit 
632-WC17.  The  program  sponsor  was  Mr.  Curt  Martin,  NAVSEA  63R13. 

Released  by  Under  authority  of 

P.M.  Reeves,  Head  R.H.  Hearn,  Head 

Electronics  Division  Fleet  Engineering  Department 


ACKNOWLEDGMENT 


The  author  wishes  to  thank  R.  Ricks  for  his  assiduous  reading  of  the  manuscript. 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  of  This  PACE  (Wh en  Data  Entered) 


REPORT  DOCUMENTATION  PAGE 

READ  INSTRUCTIONS 

BEFORE  COMPLETING  FORM 

1.  REPORT  NUMBER 

NOSC  Technical  Report  848  (TR848) 

nmnii 

3  RECIPIENT'S  CATALOG  NUMBER 

<d _ 

4.  TITLE  (and  Subtitle ) 

BAYR  -  A  DATA  ASSOCIATION  ALGORITHM  BASED  ON  A 
BAYESIAN  RECURSION 

5.  TYPE  OF  report  a  period  covereo 
Final  Report 

October  1981 -September  1982 

6.  PERFORMING  ORG.  REPORT  NUMBER 

y.  authorcai 

MJ.Shensa 

S.  CONTRACT  OR  GRANT  NUMBERIX 

S.  PERFORMING  ORGANIZATION  NAME  AND  ADDRESS 

Naval  Ocean  Systems  Center 

San  Diego,  C A  92152 

10.  PROGRAM  ELEMENT.  PROJECT.  TASK 
AREA  a  WORK  UNIT  NUMBERS 

62633N,  F33341 , 

SF33341401, 632-WC17 

II.  controlling  office  name  and  aodress 

Naval  Sea  Systems  Command 

Washington,  D.C.  20360 

12.  REPORT  DATE 

15  November  1982 

13.  NUMBER  OF  PAGES 

72 

14.  MONITORING  AGENCY  name  a  ADDRESSfl/  dlllerent  Itom  Controlling  Olllca) 

IS.  SECURITY  CLASS,  (ot  thle  report) 

Unclassified 

ISa.  DECLASSIFICATION  DOWNGRADING 
SCHEDULE 

16.  DISTRIBUTION  STATEMENT  (ol  thle  Report) 

Approved  for  public  release  distribution  unlimited 

17.  distribution  STATEMENT  (ol  the  ebelrect  entered  In  Bloch  20.  II  dlllerent  from  Report) 

li.  supplementary  notes 

19.  KEY  WORDS  (Continue  on  referee  elde  It  neceeeery  end  Identity  by  block  number) 

data  association  multisensor  tracking 

multitarget  tracking  tracking 

Baye’s  estimation  clutter 

20.  ABSTRACT  (Continue  on  reveree  elde  It  neceeeery  end  Identity  by  block  number) 


r  '■  *  y  Standard  tracking  algorithms  involve  processing  measurements  associated  with  a  given  target  and 
forming  an  estimate  of  the  target's  state.  However,  many  practical  situations  also  include  an  uncertainty 
regarding  the  origin  of  the  data.  In  the  most  general  case  one  is  faced  with  the  problem  of  tracking  targets  in  a 
multisensor  multitarget  environment,  possibly  including  highly  dissimilar  data  types  ranging  from  acoustic 
measurements  to  visual  sightings.  The  term  data  association,  as  applied  here,  refers  to  the  partitioning  of  a  set 
of  measurements  according  to  their  sources.  Each  such  partition  is  termed  a  hypothesis,  and  the  object  is  to 

(Continued  on  reverse  side) 


do 


F  ORM 
AN  73 


1473  EDITION  OF  I  NOV  es  IS  OBSOLETE 

S  N  0102-  LF.  cu-  6601 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  of  This  PACE  C***"  Data  Bntarad, 


UNCLASSIFIED _ 

SECURITY  CLASSIFICATION  OF  THIS  RAGE  fWhan  Dmtm  Bntmrmd) 

20.  Continued  L-.',  , v, 

>  find  the  best  hypothesis.  In  this  reportwe  describe  an  algorithm  which  is  intended  to  provide  a  general  frame¬ 
work  for  data  association.  It  is  cast  in  a  Bayesian  context;  that  is,  the  relative  merits  of  the  hypotheses  are  evaluated 
in  terms  of  their  aposteriori  probabilities.  However,  the  presentation  includes  the  development  of  a  general 
data  and  scoring  structure  which  should  find  application  in  most  schemes  which  evaluate  hypotheses  recursively. 

In  addition,  a  detailed  model  is  provided  for  the  case  of  bearings-only  measurements  in  a  convergence  zone 
environment.  The  methodology  used  in  developing  this  restricted  case  is  considered  a  prototype  for  future 
models. 


S  -N  0102-  LF-  014*6601 


UNCLASSIFIED 


SECURITY  CLASSIFICATION  OF  THIS  RAGEfWhMt  Dm tm  Bntmnd) 


/  r* 


SUMMARY 


Standard  tracking  algorithms  involve  processing  measurements  associated  with  a 
given  target  and  forming  an  estimate  of  the  target’s  state.  However,  many  practical  situa¬ 
tions  also  include  an  uncertainty  regarding  the  origin  of  the  data.  In  the  most  general  case 
one  is  faced  with  the  problem  of  tracking  targets  in  a  multisensor  multitarget  environment, 
possibly  including  highly  dissimilar  data  types  ranging  from  acoustic  measurements  to  visual 
sightings.  The  term  data  association,  as  applied  here,  refers  to  the  partitioning  of  a  set  of 
measurements  according  to  their  sources.  Each  such  partition  is  termed  a  hypothesis,  and 
the  object  is  to  find  the  best  hypothesis.  In  this  report  we  describe  an  algorithm  which  is 
intended  to  provide  a  general  framework  for  data  association.  It  is  cast  in  a  Bayesian  con¬ 
text;  that  is,  the  relative  merits  of  the  hypotheses  are  evaluated  in  terms  of  their  aposteriori 
probabilities.  However,  the  presentation  includes  the  development  of  a  general  data  and 
scoring  structure  which  should  find  application  in  most  schemes  which  evaluate  hypotheses 
recursively.  In  addition,  a  detailed  model  is  provided  for  the  case  of  bearings-only  measure¬ 
ments  in  a  convergence  zone  environment.  The  methodology  used  in  developing  this 
restricted  case  is  considered  a  prototype  for  future  models. 
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1.  INTRODUCTION 


Standard  tracking  algorithms  involve  processing  measurements  associated  with  a 
given  target  and  forming  an  estimate  of  the  target’s  state,  typically  position  and  velocity. 
However,  many  practical  situations  also  include  an  uncertainty  regarding  the  origin  of  the 
data.  In  the  simplest  case,  one  is  only  unsure  as  to  whether  the  measurement  is  target 
related  or  a  false  alarm.  At  other  times  the  problem  is  compounded  by  the  presence  of 
more  than  one  target.  In  general,  one  is  faced  with  the  problem  of  tracking  in  a  multi- 
sensor,  multitarget  environment,  possibly  including  highly  dissimilar  data  types  ranging 
from  acoustic  measurements  to  visual  sightings. 

Data  association  is  a  term  which  refers  to  the  process  of  partitioning  a  given  set 
of  measurements  according  to  their  sources.  Each  such  partition  is  termed  a  hypothesis, 
and  the  object  is  to  find  the  best  hypothesis.  We  recognize  in  this  informal  definition  the 
seeds  of  the  three  basic  elements  of  decision  theory  ([  1 ) .  [2] );  namely,  (1 )  a  set  of  param¬ 
eters  representing  “nature”  (the  targets,  their  states,  and  the  environment);  (2)  a  set  of 
samples  on  which  the  decision  is  to  be  based  (the  measurements);  and  (3)  a  space  of  possible 
decisions  (the  hypotheses).  However,  the  problem  as  stated  differs  from  most  textbook 
examples  inasmuch  as  the  mathematical  relationships  describing  these  three  quantities  are 
so  interwoven  that,  at  least  formally,  it  is  even  difficult  to  distinguish  between  them  (see 
section  3).  There  are  also  formidable  practical  difficulties,  both  combinational,  due  to  an 
unmanageable  number  of  hypotheses,  and  analytical,  arising  from  a  set  of  continuous  state 
parameters  which  are  related  to  the  measurements  in  a  highly  nonlinear  manner.  As  a  con¬ 
sequence  there  exists  a  large  literature  ([3]-[9])  exhibiting  a  vast  number  of  variations 
and  approaches  to  the  problem. 

In  this  report  we  describe  an  algorithm  which  is  intended  to  provide  a  general  frame¬ 
work  (very  similar  in  spirit  to  that  of  [5] )  for  data  association.  It  is  cast  in  a  Bayesian  con¬ 
text,  one  in  which  the  relative  merits  of  the  hypotheses  are  evaluated  according  to  their 
so-called  aposteriori  probabilities.  A  degree  of  generality  is  achieved  at  the  sacrifice  of  some 
rigor  and  the  acceptance  of  heuristic  techniques.  We  note  that  simple,  approximate 
methods  actually  have  a  certain  advantage  over  involved  analytical  procedures  inasmuch  as 
they  often  exhibit  an  added  robustness  when  dealing  with  a  complex  environment.  Never¬ 
theless,  an  attempt  is  made  to  ensure  that  all  our  approximations  are  motivated  by  under¬ 
lying  theoretical  considerations.  Not  only  does  such  theory  provide  a  foundation  for  heuristic 
reasoning,  it  also  promotes  the  logical  consistency  which  is  necessary  for  evaluating  the 
consequences  of  approximate  procedures  and  avoiding  serious  (but  possibly  subtle)  errors. 

AN  EXAMPLE  OF  HYPOTHESIS  GENERATION 

To  put  these  concepts  into  a  more  specific  context  consider  the  following  situation: 
an  unknown  number  of  targets  are  present  from  which  we  periodically  receive  bearing 
measurements.  We  wish  to  use  this  information  to  track  the  targets,  ultimately  we  would 
like  to  end  up  with  a  set  of  labeled  targets,  each  with  a  positional  track  determined  from 
the  associated  set  of  bearing  measurements.  We  begin  with  a  single  bearing  6  j .  This  is 
clearly  not  enough  information  to  form  a  physical  track.  In  addition  we  are  faced  with  a 
further  indeterminancy;  we  do  not  know  whether  0\  is  from  a  target  oris  noised  To  maintain 

+  Notc  that  the  choice  of  the  class  of  false  alarms  or  "clutter"  can  have  a  significant  effect  on  the  algorithm 
(cf.  section  4). 


uniformity  of  description,  let  us  call  both  possibilities  “pretracks”  so  that  in  the  above  case 
the  source  of  the  false  alarm  is  considered  to  be  some  ghost  target.  We  represent  the  two 
possibilities  by  hj  =  |0j  |  and  h2  =  {0j ,  F} ,  respectively.  Note  that  deciding  between  them 
is  the  classical  problem  of  detection  theory. 

Now,  a  second  bearing  02  is  received  resulting  in  a  total  of  six  possible  pretracks^ 
(three  are  targets  and  three  are  sets  of  false  alarms), 

T1  H^lf  T4={0,,F} 

T2  =  {*2}  T5  =  j02,Fj 

T3  =  lM2l  T6  =  {01,02,F}, 

and  5  hypotheses 


h'l  “ 

h2  = 

JM’  1^2 1. 

h3  = 

h4  = 

2.1] 

h5  = 

101.02.  Ff 

where  the  brackets  indicate  a  set  of  pretracks.  For  example,  h \  is  the  hypothesis  that  both 
0j  and  02  belong  to  the  same  target,  and  h^  is  the  hypothesis  that  0->  is  from  a  target  and 
0j  is  a  false  alarm. 

PRUNING 

We  are  already  faced  with  our  first  impasse.  As  additional  data  are  received,  the 
number  of  pretracks  and  hypotheses  rapidly  exceeds  our  capabilities  for  storage  and  com¬ 
putation.  For  N  data  points,  the  number  of  target  pretracks  is  2N  -  1 ,  the  number  of 
non-empty  subsets  of  N  points.  (There  is  also  an  equal  number  of  false  alarm  pretracks.) 
The  number  of  hypotheses  increases  even  more  swiftly.  For  example,  if  N  =  5  there  are 
203  possible  hypotheses  and  3 1  target  pretracks.  Our  only  hope  is  to  make  room  for  new 
data  by  “pruning”  unlikely  pretracks  and  hypotheses  and  by  “confirming”  those  pretracks 
which  are  almost  certain.  Note  that  a  confirmation  limits  other  pretracks  to  the  remaining 
data  points  and  thus  produces  the  same  effect  as  pruning  (i.e. ,  it  removes  certain  combina¬ 
tions  from  consideration).  Such  procedures  represent  a  clear  compromise  with  a  rigorous 
probabilistic  model.  In  particular,  the  final  result  will  certainly  depend  on  the  order  in 
which  the  data  are  entered  into  the  algorithm. 


^In  the  data  association  literature,  these  sets  of  measurements  are  usually  simply  referred  to  as  tracks. 
This  is  probably  a  legacy  of  the  radar  community  where  measurements  are  typically  a  sequence  of  posi¬ 
tions.  However,  in  this  more  general  setting  we  feel  it  is  prudent  to  use  a  separate  term,  pretrack,  to 
avoid  confusion  with  the  geographical  track. 


SCORING 


We  must  also  find  a  means  of  evaluating  or  scoring  each  hypothesis.  This  cannot  be 
predicated  solely  on  an  ability  to  convert  pretracks  into  tracks  (as,  for  example,  by  exam¬ 
ining  the  bearing  residuals  of  a  Kalman  or  maximum  likelihood  tracker).  First,  the  number 
of  possible  pretracks  may  outstrip  our  computational  capabilities  before  their  track  states 
become  observable.  That  is,  we  need  scoring  information  at  an  early  stage  in  order  to  prune 
in  a  logical  manner.  Second,  there  may  always  exist  hypotheses  with  some  pretracks  which 
contain  insufficient  tracking  information.  For  instance,  in  our  example,  if  the  bearing 
measurements  are  obtained  from  two  separate  geographically  fixed  sensors,  and  there  is  a 
single  target  present,  its  state  (e.g.,  position  and  velocity)  will  quickly  become  observable. 
However,  if  there  are  two  targets,  each  of  which  is  within  contact  of  only  one  of  the  sensors, 
neither  state  is  observable.  Apriori,  both  are  feasible  hypotheses,  and  we  must  be  able  to 
measure  their  relative  likelihood.  (Of  course,  in  this  simple  case  one  could  just  accept  the 
former  hypothesis  if  there  exists  a  track  with  a  reasonable  fit  to  the  data;  otherwise,  one 
assumes  two  targets.  However,  when  we  begin  to  consider  the  possible  presence  of  more 
targets,  and  the  effects  of  noisy  measurements,  the  dilemma  becomes  quite  real.) 

As  mentioned  previously,  our  scoring  criterion  is  the  aposteriori  probability;  that  is, 
the  probability  of  a  hypotheses  given  the  data,  which  we  denote  P(h|3)).  (Throughout  this 
report  a  capital  “P”  shall  stand  for  probability  and  a  vertical  bar  for  conditional  probability.) 
Since,  as  new  data  arrive,  we  wish  to  update  our  model,  it  is  desirable  to  compute  the  above 
quantity  recursively.  Such  an  expression  is  obtained  by  a  simple  application  of  Bayes’  rule 
(cf.  [S], 


P(h'|d',0) 


P(h',d'|h,g)) 

P(d'|fl» 


Pfh|0)+ 


(1) 


where 

h'  =  new  hypothesis 
h  =  old  hypothesis 
d'  =  new  data  point 
S)  =  set  of  previous  data 

Note  that  it  is  assumed  that  h'  is  generated  by  h  so  that  the  event  h'  and  h  is  the  same  as 
the  event  h' .  To  clarify  this  point,  we  write  equation  (1)  for  the  example  of  two  bearing 
measurements  discussed  above: 


P(h:|0,,0:) 


P(h;,e2ih,,01) 

P(02l0j) 


P(h|,02lh  2,0j) 
P(0  ->  10 1 ) 


P(h,  |0j) 

P(h2l0 , ) 


i=  1, 2,3 


i  =  4,  5 


+There  is  some  abuse  of  notation  since  although  P(h'.d)  represents  a  set  of  discrete  probabilities  with 
respect  to  h',  it  is  typically  a  probability  density  with  respect  to  d'.  For  example,  d'  may  be  a  bearing 
measurement  which  takes  on  a  continuous  set  of  values. 


Thus,  there  is  a  very  natural  structure  for  the  recursive  generation  of  hypotheses  (and 
similarly  for  pretracks).  With  the  arrival  of  #2*  the  hypothesis  hj  =  [j  0  j  Jl  generates  three 
possibilities:  h'j  =  [{01,02}]  ^  ;and  h3  =  [{el}>{e2>Ff]-  The  hypothesis 

h2  =  [{ 0 1  >F }]  generates  h^  and  h^.  The  probability  that  h  j  or  h'2  or  h^  will  occur  given 
that  h2  was  true  prior  to  receiving  0  2  *s  zer0- 

We  finally  are  in  a  position  to  briefly  describe  our  algorithm  (summarized  in  Figure 
1).  It  contains  a  data  structure  for  measurements,  pretracks,  and  hypotheses;  new  data  are 
added  by  recursively  generating  new  pretracks  and  new  hypotheses.  These  are  then  scored, 
based  on  previous  scores  by  means  of  a  Bayesian  recursion;  when  necessary,  pruning  opera¬ 
tions  are  performed  to  remove  hypotheses  or  pretracks  of  zero  or  low  probability.  We  also 
mention  that  our  algorithm  is  more  general  than  the  terminology  of  equation  (1)  might 
indicate.  We  may,  without  impunity,  interpret  d'  in  a  much  wider  sense;  for  example,  as 
an  entire  physical  track.  Such  a  point  of  view  is  useful  in  the  presence  of  fading  signals 
where  we  might  wish  to  associate  two  entire  tracks,  separated  in  time,  with  a  single  target 
(cf.  [9]). 

MODELING 

We  have  yet  to  address  the  problem  of  modeling  the  distributions  which  appear  in 
(1).  The  quantity  P(h|2>)  is,  of  course,  available  from  the  previous  stage.  If  P(h',d'|h,<0)  is 
known,  we  may  determine  P(d'i<D)  by  summing  over  h'  in  (1)  and  using  the  equation 

]£p(h'id',0)  =  1  (2) 

h' 


LOOP 

OVER 

ALL 

PARTITIONS 


I  (-..LINE 


next'  Datum 


Figure  1.  Generalized  flowchart  of  BAYR. 


provided  we  make  the  stipulation  that  at  any  stage  every  hypothesis  contains  all  the  data 
points  up  to  that  stage;  i.e.,  that  P(d'|fl) )  is  independent  of  h'.  That  leaves  us  with 
P(h',d’|h,i0)  to  model.  A  completely  rigorous  approach  is  out  of  the  question.  We  shall 
insist,  however,  that  the  probabilities  assigned  are  consistent  with  some  abstract  sample 
space  (Appendix  B).  In  particular,  we  require  that  ^  £  P(h',d'  |  h,3))  =  1 .  [Note  that  this 
restriction  is  not  equation  (2).]  Thus,  our  modeled  distributions  will  truly  be  probability 
densities  although  they  may  only  be  an  approximation  to  the  statistics  of  the  real  world. 

In  order  to  model  P(h',d'  |  h,<D),  it  is  convenient  to  consider  three  cases:  (a)  d'  is  a 
false  alarm ;  (b)  d'  comes  from  a  new  target ;  and  (c)  d'  is  associated  with  a  previously  postu¬ 
lated  target.  Such  a  procedure  is  carried  out  in  section  4.  It  has  the  advantage  that,  given 
(a)  or  (b)  or  (c),  the  computation  of  P(h',d'  j  h ,3))  may  be  only  weakly  dependent  on  h  and 
in  case  (c)  depends  almost  entirely  on  the  pretrack  associated  with  d'.  For  instance,  in  our 
example,  if  we  receive  a  third  measurement  0 3,  then  under  (c)  0 3  may  associate  with  either 
|0  j|  or  |02f  to  form  the  pretracks  |0  j.Oj}  or  j  03.03}  >  respectively.  Let  us  define 
h'2  =  [l^i  ^3} .  {03}]  anc*  ^3  =  [|#i  >^3} .  {0 2’F  0  •  Then  it  is  not  unreasonable  to  expect 
that  the  probabilities  P(h^,0-,  |  h'-,,0  j  ,07)  and  Pfh^^  |  h^,0  j  ,03)  are  entirely  dependent 
on  (or  at  least  simple  functions  of)  the  probability  of  association  of  03  with  0  j ;  i.e.,  they 
are  dependent  on  the  pretrack  |0 1,03}  and  not  directly  on  the  hypotheses  h'->,  h'2,,  I13, 
and  h^.  t  This  results  in  a  significantly  reduced  computational  load  since  the  number  of 
hypotheses  generally  greatly  exceeds  the  number  of  pretracks. 

SUMMARY 

Let  us  briefly  summarize  the  path  of  development  from  a  physical  description  of 
the  data  association  problem  to  a  specific  algorithm  for  its  solution: 

(i)  We  assume  that  nature  has  some  underlying  structure  which,  at  least  verbally, 
can  be  described. 

(ii)  That  structure  is  “modeled”  (e  g.,  state  equations  and  an  observation  function 
are  specified).  The  result  is  a  series  of  mathematical  constructs  about  which 
we  may  speak  precisely. 

(iii)  We  create  a  machinery  for  the  decision  problem  ,  definitions  of  hypothesis, 
of  the  relative  probability  of  hypotheses,  etc.,  expressed  in  terms  of  the  con¬ 
structs  formed  in  (ii). 

(iv)  An  algorithm  is  specified  with  data  measurements  as  input  and  a  preferred 
hypothesis  (or  ordering  of  hypotheses)  as  output.  The  objects  of  the 
algorithm  must  be  defined  in  terms  of  the  measurements. 

We  remark  that  some  of  the  definitions  (iii)  may  be  abstracted  in  the  sense  that  they  apply 
to  a  class  of  models  rather  than  a  specific  model  developed  in  (ii). 


+Tl.is  is  u  slight  exaggeration  of  the  true  situation.  See  section  4  for  details. 


The  success  of  such  a  procedure  will  depend  on  how  well  the  probabilities  corres¬ 
ponding  to  the  algorithm  in  (iv)  approximate  the  probability  space  of  (iii),  and  how  well  the 
model  in  (ii)  approximates  the  situation  in  (i).  Judging  this  success  (or  failure!)  is  in  itself 
a  difficult  problem;  however,  a  simulation  should  at  least  be  able  to  evaluate  the  consis¬ 
tency  of  the  results  relative  to  the  assumptions  in  (ii). 

Our  presentation  shall  be  in  the  reverse  order  of  the  above  description.  Thus,  sec¬ 
tions  2,  3,  and  4  correspond  to  points  (iv),  (iii)  and  (ii),  respectively.  This  is  done  because 
the  difficulty  of  describing  these  constructions,  both  conceptually  and  analytically,  seems 
to  be  in  the  reverse  order;  i.e.,  (iv)  is  the  simplest  and  (ii)  the  most  complex. 

In  section  2  we  describe  the  data  structure,  the  generation  of  pretracks  and  hypoth¬ 
eses,  and  pruning  mechanisms.  All  definitions  are  in  terms  of  the  input  data  and  lead 
directly  to  a  software  implementation.  In  section  3  we  briefly  discuss  the  Bayesian  view¬ 
point,  abstract  probability  spaces,  and  a  suitable  definition  of  hypothesis  for  this  context. 

In  section  4  we  derive  one  possible  model  of  the  probability  distributions  appearing  in 
equation  (1)  for  the  case  of  bearings-only  measurements  in  a  convergence  zone  environ¬ 
ment.  The  methodology  used  in  developing  this  restricted  case  is  considered  a  prototype 
for  future  models.  Appendix  B  is  an  attempt  to  construct  a  formal  probability  space  cor¬ 
responding  to  the  algorithm  presented  in  section  2.  The  remaining  appendices  are 
self-explanatory. 


2.  A  DATA  STRUCTURE  FOR  PRETRACKS  AND  HYPOTHESES 


This  section  establishes  a  general  framework  for  the  algorithm.  Consequently,  an 
attempt  has  been  made  to  make  it  as  independent  as  possible  from  specific  physical  appli¬ 
cations.  Both  the  problem  and  the  algorithm  are  formulated  in  terms  of  data  structures 
and  their  manipulation,  and  the  presentation  is  software  oriented.  Thus,  for  example, 
although  we  include  a  discussion  of  scoring,  it  is  concerned  with  the  mechanics  of  scoring 
rather  than  modeling  techniques  which  might  relate  to  the  measurement  process,  target 
states,  or  other  physical  properties  of  a  surveillance  scenario.  We  begin  with  some 
definitions. 


2.1  NOTATION  AND  DEFINITIONS 

dj  =  data  point,  a  vector  measurement  assumed  to  be  associated  with  a  single 

(possibly  unknown)  target.  Its  components  may  include  time  of  measurement, 
location  of  measurement,  etc.  The  subscript  i  is  simply  an  identifier  used  to 
distinguish  different  data  points. 

T:  =  pretrack,  a  set  of  data  points  which  may  also  include  the  symbol  “F.”  We  use 
the  representation  T  =  jd->.  dg,  dg}  where  the  braces  indicate  the  set  relation¬ 
ship.  If  F  is  included  as  in  lFd2d3l-  the  pretrack  is  considered  a  set  of 
“false  alarms":  otherwise,  it  is  a  “target  pretrack." 

hj  =  hypothesis ,  a  set  of  pretracks  which  “partition"  the  set  of  all  data  points, 
including  the  symbol  F.  Thus,  h  is  a  hypothesis  if  and  only  if 

(a)  T|  e  h  and  T-i€h=>TjnT->  =  0  (that  is.  T  j  and  T->  are  disjoint),  and 


(b) 


U  T:  =  set  of  all  d:  union  F:  that  is,  every  data  point  must  appear  in  h.t 
T:Qi  J 


Pj  =  primitive,  a  pretrack  which  is  input  to  the  algorithm.  This  may  consist  of  a 
single  data  point.  P4  =  jd  j  -j\ .  for  example. 


Rj  =  report,  a  set  of  primitives,  all  of  which  are  assumed  to  be  associated  with  dif¬ 
ferent  targets. 


Several  remarks  are  in  order.  First,  the  symbol  F  in  a  hypothesis  simply  distinguishes 
that  pretrack  in  the  partition  which  contains  all  the  false  alarms.  If  just  |F|  appears,  then 
there  are  no  false  alarms.  Thus,  d  | .  |d]  | .  and  [idiMFf]  are  three  distinct  entities.  The 


*Set  notation 

<t>  =  empty  set  =  j  | 

U  =  set  union 
O  =  set  intersection 
€  =  set  membership 
C  =  set  inclusion 

|  x  [  y  |  =  set  of  all  x  such  that  y  is  true;  for  example. 

^  T:  =  Idjl  d:  €  T-.  T:  €  h  for  some  j  [ 
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first  is  a  data  point,  the  second  is  a  pretrack  consisting  of  one  data  point,  and  the  third  is  a 
hypothesis  (provided  d  j  is  the  only  data  point)  consisting  of  a  single  pretrack  jd  j } .  Also 
we  note  that  although  all  primitives  are  pretracks,  the  reverse  is  not  true.  For  instance,  a 
typical  situation  may  include  two  data  measurements,  dj  and  d2,  which  are  input  separately 
as  primitives  p]  =  |dj|  and  P2  =  {^2}’  anc*  ^ater  associated  to  form  the  pretrack 
T  =  pj  u  P2  =  jdj,  J  which  is  not  a  primitive.  One  purpose  for  defining  primitives  as 
pretracks  rather  than  as  data  points  is  to  allow  for  the  possibility  of  inputting  an  entire 
pretrack.  For  example,  a  radar  or  sonar  operator  may  provide  an  entire  set  of  measurements 
which  are  all  specified  as  coming  from  the  same  target. 

2.2  A  DATA  STRUCTURE  FOR  PRETRACKS 

The  set  of  data  measurements  generates,  in  a  natural  manner,  a  directed  graph  of 
pretracks  whose  edges  correspond  to  set  inclusion.  Such  a  graph  is  illustrated  in  Figure  2. 
Let  us  examine  in  detail  a  data  sequence  by  which  this  particular  structure  may  have  been 
generated. 


\  / 

T3 

\ 


Figure  2.  Example  of  a  graph  of  pretracks.  The  arrows  represent 
inclusion:  thus  Ty  =  Tj  U  Tt  U  T4. 


First  a  measurement  d  ]  enters  our  data  base  giving  rise  to  a  single  pretrack  T  j  =  {d  |  [ . 
(For  reasons  which  will  be  made  clear  in  section  2.3.  we  only  concern  ourselves  with  target 
pretracks,  not  false  alarms.)  Upon  reception  of  T2  =  |d2  f  there  are  two  new  possible 
target  pretracks,  T2  itself  and  T3  =  Tj  u  T2-  The  resulting  graph  is 


'  * 2 
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The  next  pretraek  14=  Jd3 }  has  three  possible  associations,  Tj,  T2,  or  T3;  thus,  at  the 
third  “scan”  we  have 


Now,  suppose  that,  after  scoring  the  hypotheses  corresponding  to  these  pretracks,  we  find 
that  T5  and  have  zero  probability,  and  they  are  removed  from  the  graph.  This  leaves 


A  fourth  point,  Tg  =  | is  then  added,  but  due  to  scoring  considerations,  only  its 
associations  with  T4  and  T7  are  retained. 


Finally,  T  j  |  =  jdjl  arrives  and  refuses  t  associate  with  any  of  the  other  pretracks  resulting 
in  Figure  2. 
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Note  that  the  link  (edge)  structure  for  a  given  set  of  pretracks  is  not  unique ;+  it 
depends  on  the  order  in  which  the  data  points  arrive  and  the  order  in  which  pruning  opera¬ 
tions  are  performed.  However,  the  graph  possesses  two  significant  properties. 

(a)  Each  pretrack  is  uniquely  determined  by  its  ances tors. 

(b)  Given  any  Tj  and  Tj,  there  is  at  most  one  path  linking  Tj  and  Tj.  Thus,  the 
subgraph  consisting  of  a  pretrack  T  and  its  descendents  forms  a  tree  [  10) . 

By  a  path  from  Tj  to  Tj  we  mean  a  set  of  directed  links  leading  from  Tj  to  Tj.  In  that  case 
Tj  is  said  to  be  an  “ancestor”  of  Tj  and  Tj  is  a  “descendent”  of  Tj.  If  there  is  a  single  link 
joining  Tj  and  Tj,  the  terms  “parent”  and  “child”  are  used.  Observe  that  although  Tj,  a 
descendent  of  Tj,  certainly  implies  that  Tj  c  Tj,  the  converse  is  not  true;  i.e.,  Tj  C  Tj  =£>  Tj 
is  a  descendent  of  Tj.  The  proof  of  (b)  is  given  in  Appendix  A. 

Property  (a)  is  important  because  it  alleviates  the  need  for  storing  (or  even  directly 
linking)  a  set  of  data  points  with  each  track;  they  only  need  to  be  linked  to  the  roots  of  the 
graph.  Property  (b)  is  useful  in  accessing  data  (e.g..  by  recursive  procedures).  However,  the 
greatest  motivation  for  the  above  representation  is  that  it  admits  a  particularly  simple 
algorithm  for  the  generation  of  new  pretracks.  (In  fact,  it  would  be  more  correct  to  say 
that  the  representation  is  a  consequence  of  the  generating  mechanism.)  This  algorithm  is 
illustrated  in  Figure  3. 

There  are  some  additional  constructs  which  prove  useful  in  the  implementation  of 
such  a  data  structure  on  a  computer.  One  of  these,  “primitives.”  has  already  been  men¬ 
tioned.  Instead  of  data  points,  we  input  sets  of  data  points;  i.e..  pretracks.  These  may  be 
represented  as  in  Figure  4,  and  thought  of.  in  a  sense,  as  permanent  roots  of  the  graph 
(they  may  be  removed  only  if  they  have  no  children).  Thus,  when  a  pretrack  such  as  Tj  is 
removed  (cf.  Figures  2  and  4),  pj  remains  to  specify  the  contents  of  T3. 

The  second  concept,  that  of  a  “report."  allows  one  to  specify  a  set  of  primitives 
which  are  not  allowed  to  associate  with  each  other  (i.e..  are  assigned  to  different  targets 
with  probability  one).  For  example,  in  Figure  4.  P4  and  P5  are  both  from  the  same  report 
and  are  not  allowed  to  associate.  In  contrast.  P3  and  P4  could  not  have  come  from  the 
same  report  since  they  are  associated  in  tracks  T9  and  Tjo  A  generalization  of  the 
algorithm  of  Figure  3,  which  takes  reports  into  account  is  found  in  Figure  5.  Note  that 
during  execution  of  the  large  block,  the  set  3  remains  fixed,  thus  preventing  the  crea¬ 
tion  of  any  pretracks  containing  more  than  one  p  from  R. 

Primitives  and  reports  are  simply  devices  for  inputting  information,  or  more  pre¬ 
cisely,  an  efficient  means  of  introducing  constraints  on  the  input  data.  A  primitive  asso¬ 
ciates  a  set  of  data  points  with  certainty  upon  input,  whereas  a  report  disassociates  sets 
of  data  with  certainty.  Both  could  be  replaced  by  the  more  fundamental  concept  of  a 
data  point  accompanied  by  information  specifying  possible  constraints  on  its  association. 

In  that  case  one  would  input  a  single  data  point  at  a  time,  and  each  time  execute 
G  (9\{d|)  with  U  restricted  to  the  set  of  pretracks  with  which  d  might  associate.  In 
fact  this  procedure  is  more  general  than  Figure  5.  However,  it  would  also  require  more 
storage  space,  more  frequent  input  of  data,  and  a  search  over  the  pretrack  graph  in  order 
to  determine  which  pretracks  are  allowed  to  associated  with  the  input  data  point,  that  is 
in  order  to  construct  the  set  £7. 

't'There  is  not  even  a  unique  graph  with  a  minimal  number  oflinks.  Consider,  lor  example,  the  two  graphs 
obtained  by  inputting  dj .  d^.  dj  and  d2-  <13 ■  d ) .  respectively,  with  no  pruning. 
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Figure  5.  Algorithm  for  pretrack  generation  upon 
receipt  of  a  “report.” 


2.3  HYPOTHESIS  GENERATION 

As  defined  in  section  2.1,  a  hypothesis  h  is  a  set  of  pretracks  subject  to  two  condi¬ 
tions  (here  expressed  in  terms  of  primitives): 

(a)  Any  two  pretracks  in  h  are  disjoint. 

(b)  The  union  of  all  the  pretracks  in  h  equals  the  union  of  all  primitives  and  the 
symbol  F. 

Thus,  if  pi ,  P2  and  P3  comprise  the  set  of  all  primitives,  then  [pj .  p2  u  P3,  |F|]  is  a 
hypothesis  whereas  [ p j  u  P2,  P2  u  P3,  |Fj]  and  [pj .  P2-  |F{]  are  not.  More  simply 
expressed,  a  hypothesis  is  a  partition  of  the  data  (and  F):  for  example,  if  pj  =  |dj|  , 

P2  =  {^2!,  and  P3  =  |d3,  d4},  then  the  hypothesis  h  =  [pi  ,  P2  U  P3,  {F}]  = 

[{dj},  }d2,  d3,  d4 { ,  |F}]  is  a  partition  of  dj,  d2»  d3,  d4,  F. 

Although  our  current  notation  is  well  adapted  for  the  development  of  a  precise 
definition  of  hypothesis,  it  is  somewhat  cumbersome  and  inefficient  for  implementation. 
For  example,  it  is  easily  seen  (cf.  section  1)  that  one  half  of  the  pretracks  are  false  alarms. 
Thus,  we  can  greatly  simplify  our  bookkeeping  and  logic  by  agreeing  not  to  explicitly 
represent  false  alarm  pretracks.  Since  each  hypothesis  h  contains  at  most  one  false  alarm 
pretrack  (property  (a)),  that  pretrack  can  be  inferred  from  the  data  base  by  taking  the 
complement  of  the  target  pretracks,  which  we  explicitly  represent  in  h.  (This  follows 
from  property  (b).) 

Also,  strictly  speaking,  we  have  been  somewhat  remiss  in  our  definition  of  hypothe¬ 
sis.  The  empty  pretrack  <t>  =  \  \  is  a  perfectly  valid  pretrack  and,  according  to  our  definition, 
it  may  or  may  not  be  present  in  any  hypothesis.  Since  we  do  not  wish  duplications  of 
physical  hypotheses  (for  example,  to  include  both  [|d] ,  d3j,  |d2-  F| ,  <p ] 
and  [{dj,  d3$,  |d2,  F}] ,  we  make  the  convention  that: 

(c)  Every  hypothesis  contains  the  empty  pretrack  <p  (and  contains  it  only  once). 


This  pretrack  is  simply  a  mathematical  construct  which  helps  to  unify  our  treatment  of 
hypothesis  generation.  In  particular,  prior  to  the  reception  of  data  our  state  consists  of 
the  single  hypothesis  [0,  |F}]  so  that  start-up  is  handled  exactly  the  same  as  any  other 
stage  of  the  algorithm. 

Let  us  illustrate  these  concepts  by  examining  the  generation  of  tracks  and  hypothe¬ 
ses  through  two  input  stages.  Initially,  we  start  with  two  pretracks  and  a  single  hypothesis: 

T j  =  0  and  T2  =  {FI 

hj  =  [0,  | Fj]  represented  by  [0] 

The  tilde  indicates  that  ?2  is  not  represented  internally  in  the  graph  of  target  pretracks. 
The  input  of  a  primitive  pj  generates  two  new  pretracks 

T3  =  p|u0  =  pj  and  T4  =  pjU{Ff 
and  two  hypotheses 


Hypothesis 

Representation 

h2=  I*.  Pu  |F}] 
h3=  [0-  Pi  u  |F|] 

=  it,.t3i 

M-ITjI 

Note  that  although  hj  and  113  have  the  same  representation,  there  is  no  chance  of  confusion 
In  fact,  once  pj  has  been  input  to  the  computer,  hj  is  no  longer  even  a  hypothesis  since  it 
does  not  satisfy  condition  (b). 

Upon  receipt  of  P2  we  have  additional  pretracks 

T5  =  p2uTi=p2  T6  =  p2uT2  =  p2u  {f} 

T7  =  p2  u  T3  =  P2  u  Pj  Tg  =  p2  U  T4  =  P2  U  Pj  u  {f} 

and  hypotheses  (Table  1) 


Hypothesis 

Representation 

h4=  [0,  Pj»  P2<  }Ff] 
h5=  [0,  p2u  p,,  |F}] 

h6=  (0-  Pi*  P2U 
h 7  =  [0,  P2'  Pj  u  jF}] 
h8=  [0,  p2u  pj  u  }F}] 

[0,  pj,  p2]  =  (Tj.  T3,  T5I 
[0,  p2  u  p|]  =  [Tj.T7l 

[0-  Pi]  =  lTl-T3l 
[0,  p2]  =  tTj,  T5) 

101  -  [T ,  1 

Table  I .  Hypothesis  representation. 


An  Algorithm  for  Hypothesis  Generation 


Observe  that  I12  has  generated  114,  h5  and  h^  while  I13  generated  I17  and  hg.  The 
mechanism  is  always  association  of  the  new  primitive  ps  with  one  of  the  pretracks  of  the 
generating  hypothesis.  We  donate  this  process  by  h  -  h'.  If  the  associating  pretrack  is  a 
false  alarm  as  in  h2  -* **  h^.  then  the  representation  remains  unchanged  IT j .  T3I  -*  |Tj .  T3 ) . 
From  this  point  on  we  shall  not  distinguish  between  hypotheses  and  their  representations, 
relying  on  the  context  to  avoid  confusion.  This  allows  us  to  write,  for  example,  h  -*  h.  a 
statement  implying  that  new  data  has  been  added  but  is  a  false  alarm  under  the  new 
hypothesis  h.  (Thus,  the  h  on  the  right  hand  side  has  a  different  false  alarm  pretrack  from 
the  one  on  the  left,  although  its  representation  is  the  same.)  We  make  the  following  formal 
definition: 

Def  -  Let  h  be  a  hypothesis,  and  T  and  T"  pretracks  such  that  T  €  h.  Then  we  say 
that  h  generates  h'  as  T  -*  T"  (i.e..  as  T"  replaces  T)  if  and  only  if* 

(h-[T)u[T"l  T*0 

h'=J  (3) 

(huin  T  =  0 

We  designate  this  by  h  -+  h' 

T.T" 

Observe  that  pretrack  generation  and  hypothesis  generation  occur  in  parallel.  A  new 
primitive  p  =  T'  is  either  a  false  alarm  or  generates  new  pretracks  by  T"  =  T'  u  1  where  T  is 
an  existing  pretrack.  The  corresponding  hypotheses  generated  are: 

(i)  h  -*■  h ;  p  is  a  false  alarm  so  that  T'  *  p  does  not  appear  explicitly 


(ii) 

(in) 


h  -*■  h’ ;  T'  =  T'  u  0  appears  as  a  pretrack  representing  a  new  target 
0.T' 

h  -»■  h'  ;  T'  appears  in  T"  =  T'  u  T  by  associating  with  a  previous  pretrack  T 
T.T" 


We  are  now  in  a  position  to  describe  a  hypothesis  generation  algorithm.  Let  O'  be  a 
symbol  representing  a  set  (or  list)  of  pretracks  and.#,  a  set  of  hypotheses.  First  we  record 
our  current  state;  i.e..  we  set  £7  =  the  set  of  all  (target)  pretracks  and  .#  =  set  of  all  hypothe¬ 
ses.*- 1  Then,  upon  receipt  of  T'  =  p.  the  new  set  of  hypotheses  consists  of  the  old  set  of 
hypotheses.#  plus,  for  every  T  in  £7  and  all  h  such  that  Teh.  those  hypotheses  h'  generated 
from  h  by  T  -*■  T  u  T'.  This  algorithm,  including  the  generation  of  new  pretracks,  is  dia¬ 
grammed  in  Figure  6. 

Several  remarks  are  in  order.  First,  in  implementing  the  algorithm,  one  must  be 
careful  as  one  loops  through  the  pretracks  T  e  £7  and  hypotheses  he.#  creating  new  pre¬ 
tracks  and  hypotheses,  that  these  new  pretracks  and  new  hypotheses  are  not  used  as 
generators  in  later  stages  of  the  loops.  This  is  the  reason  that  the  sets  £7  and.#  are  fixed 
prior  to  generation;  i.e.,  they  are  not  changed  while  executing  HGEN  (£7..#.  T'). 


*The  sign  indicating  set  difference,  may  be  defined  by  A  -  B  =  jxlx  E  A,  x  £  B| 

**The  reader  should  be  careful  not  to  confuse  £7  (or  ,# )  with  the  graph  of  pretracks  (or  hypotheses).  At 
intermediate  stages  of  hypothesis  generation  these  do  not  coincide.  An  appropriate  conceptualization  is 
£7  =  set  of  pretracks  capable  of  association  with  the  input  and.#=  set  of  generating  hypotheses. 
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input  T'  =  p 


put  9  =  set  of  pretracks 


put  .H  -  set  of  hypotheses 


HGEN  (g,.*,T  ) 


Figure  6.  Diagram  of  algorithm  for  generation  of  pretracks  and 
hypotheses.  The  word  “add”  means  add  to  the  data  structure. 

The  large  block  is  the  procedure  HGEN  O',.#.  T'). 

Secondly,  the  word  add  in  Figure  6  (which  is  short  for  “add  to  the  data  structure”) 
needs  further  clarification.  For  pretracks,  adding  involves  the  creation  of  nodes  and  links 
in  the  manner  already  detailed  in  section  2.2.  For  hypotheses,  it  involves  the  creation  of  a 
set  which  is  a  procedure  we  have  yet  to  specify.  There  are  many  computer  data  structures 
suitable  for  the  implementation  of  a  family  of  sets.  In  the  present  algorithm,  which  has 
been  programmed  in  PASCAL,  we  chose  to  represent  hypotheses  by  sets  attached  to  pre- 
tracks.  Each  pretrack  T  is  linked  to  a  set,  denoted  .#  *(T),  consisting  of  (names  of)  all  the 
hypotheses  which  contain  that  pretrack  (cf.  Figure  7).  Thus,  a  hypothesis  h  may  be  recon¬ 
structed  by  determining  all  T  for  which  h  is  contained  in  .#  *(T).  Conversely,  a  hypothesis 
h  is  contained  in  the  set  .#  *(T)  if  and  only  if  T  e  h.  (The  confused  reader  should  see 
Appendix  A  for  a  more  detailed  discussion.) 

Adding  h’  in  the  generation  h  -*  h’  is  achieved  simply  by  adding  h’  to  the  appropriate 

TT" 

sets;  namely,  to  all  sets.#  *(Tj)  attached  to  pretracks  Tj  for  which 


(a)  T 

(b)  T, 

(c)  T 


€  h  when  T  =  0,  or 
e  h  and  Tj  #  T.  or 
=  T". 


Note  that  (a)  and  (b)  are  not  mutually  exclusive.  The  above  scheme  results  in  the  algorithm 
pictured  in  Figure  8.  which  was  obtained  from  Figure  6  by  filling  in  the  above  implementa- 
tional  details.  The  PASCAL  code  appears  in  Appendix  A.  figure  A-2. 
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pretracks  T 


set.#*(T) 


Figure  7.  Illustration  of  sets  of  hypotheses  (T)  attached  to  pretracks  T 
corresponding  to  Table  1 .  Thus,  the  integers  4  through  8  label  hypotheses 
I14  to  hg,  and  we  can  deduce  from  the  above  set  structure  that,  for  example, 
hf,  =  [T  | .  T3]  or  that  T3  appears  in  hypotheses  114  and  h6. 


Figures.  Expanded  diagram  of  HGEN  (O..#.  T  ).  Note  that  the 
last  statement  relies  on  the  fact  that  h  £.#*  (<t>)  for  all  h. 
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Inputting  Reports 

Reports  are  handled  by  executing  HGEN  (£?,.#,  p)  one  primitive  at  a  time,  updating 
,#  each  time  but  leaving  3  fixed.  Since  3  is  fixed,  each  primitive  of  the  report  is  only  al¬ 
lowed  to  associate  with  the  original  set  of  pretracks;  i.e.,  report  primitives  do  not  associate 
with  each  other.  The  algorithm  is  found  in  Figure  9.  To  clarify  its  operation  we  present  a 
simple  example. 


Figure  9.  Generation  of  pretracks  and  hypotheses  with 
reports  as  input. 

Our  example  starts  with  two  pretracks,  0  and  T j ,  and  a  single  hypothesis  hj  =  [Tj  1 . 
Thus,  3=  }</>,  T](  and,#  =  {hi}.  Let  R  =  (pj .  P2).  Inputting  p)  generates 

t2  =  p1’  t3  =  p1uT1 

h2  =  IT i  -  T2 1 '  >'3  =  ^3) 

Following  Figure  9,  we  next  replace,#  with  the  current  set  of  hypotheses,  i.e., 

»#  -*■  jhj,  In,  h3 } .  Then  we  input  the  primitive  p^  which  generates  new  pretracks  by 
associating  with  3  =  { 0,  T  | }  resulting  in 

T4  =  P2>  T5  =  P2  u  Tj 

and  generates  five  new  hypotheses  by  h|  -+  [T j .  T4I ;  h|  -*  [T5I ;  In  -  l T j .  T2.  T4I ; 

h2_”  IT5.  T2 1 1  h3  -►  [T3>T4|.  This  is  the  same  result  which  would  have  been  obtained 

by  inputting  first  pj  and  then  p2  with  no  restrictions  (in  other  words  we  update  3  as  in 
Figure  6)  and  then  removing  all  pretracks  containing  pj  u  P2  as  well  as  all  hypotheses 
containing  such  pretracks.  It  is  an  enlightening  exercise  to  prove  this  in  the  general  case. 
(Try  induction  in  the  number  of  primitives  in  the  report.) 


Finally,  it  is  very  important  to  note  that,  just  as  in  the  case  of  track  generation 
(section  2.2).  HGEN  (3\.4(,  T')  may  be  used  with  more  general  constraints  than  those  of 
a  report.  These  constraints  may  be  incorporated  by  restricting  £7  to  the  set  of  tracks  with 
which  T’  is  permitted  to  associate.  An  interesting  application  of  this  might  be  to  a  man- 
machine  interfaced  system  in  which  the  human  notices  the  unreasonableness  of  certain 
associations  although  the  situation  has  not  been  anticipated  by  the  programmer.  The  user 
may  then  influence  the  operation  of  the  data  association  algorithm  by  placing  appropriate 
restrictions  on  the  set  £7. 

Space  Considerations 

Before  accepting  a  new  primitive  with  its  subsequent  generation  of  new  pretracks 
and  hypotheses,  we  must  determine  whether  there  is  sufficient  storage  space  to  accommo¬ 
date  their  presence.  Also,  if  space  is  lacking,  we  wish  to  know  exactly  how  much,  so  that 
in  making  room  we  do  not  reduce  the  effectiveness  of  our  algorithm  by  pruning  more  than 
necessary  (cf.  section  2.4). 

The  number  of  target  pretracks  which  can  be  formed  from  N  data  points  is  2^; 
i.e..  the  number  of  possible  subsets.  The  number  of  possible  hypotheses  (i.e..  the  number 
of  partitions  of  N  +  1  objects  since  the  computation  includes  false  alarms)  is  not  so  easily 
computed.  A  recursion  is  given  by  (11). 


where  A^  =  number  of  hypotheses  for  k  data  points,  and  A_i  =  1 .  However,  in  practice 
these  quantities  constitute  a  rather  poor  upper  bound  since  after  the  first  few  stages  of 
generation  the  set  of  pretracks  almost  certainly  does  not  contain  every  possible  subset  of 
data  points.  Such  a  situation  occurs  as  a  result  of  pruning,  the  inputting  of  primitives  con¬ 
sisting  of  more  than  a  single  data  point,  and  from  the  restrictions  on  association  placed  by 
reports.  Similar  considerations  apply  to  the  set  of  hypotheses. 

Fortunately,  we  are  able  to  overcome  this  difficulty  and  ease  the  burden  of  com¬ 
puting  (4)  at  the  same  time.  The  algorithm  HGEN  (2 ! .M.  p)  permits  one  to  predict  the 
number  of  pretracks  and  hypotheses  which  will  be  generated  at  the  next  stage  through  a 
very  simple  calculation.  A  glance  at  Figure  8  reveals  that  the  number  of  new  pretracks 
generated  is  equal  to  the  number  of  pretracks  in  £7, 

#  new  pretracks  =  #  £7.  (5) 

and  the  number  of  new  hypotheses  is  the  sum  of  the  number  of  elements  in .  W*(T)  for 
all  T  €  £7 

#  new  hypotheses  =  2  #.#*(T)  ( t> ) 

Te3 

Note  that  these  numbers  are  expressed  in  terms  of  the  state  of  the  data  base  after 
completion  of  the  acquisition  of  the  previous  primitive  and  just  prior  to  inputting  the  next 
one.  A  simple  means  of  facilitating  these  computations  is  to  store  with  each  pretrack  T  an 
integer  f  tual  to  the  number  of  elements  in  M  *(T).  This  integer  is  updated  every  time  a 
hypot^-ii.  is  added  (or  subtracted  as  happens  when  pruning)  toJ(*(T).  When  the  set  £7  is 
first  cmed  these  numbers  are  simply  added,  and  simultaneously  a  count  of  the  number  of 


pretracks  is  kept  for  equation  (5).  During  pruning  or  the  input  of  more  than  one  primitive 
from  a  given  report  (Figure  9),  the  initial  summation  need  not  be  repeated  provided  one 
keeps  a  running  count  as  new  hypotheses  are  added  to  (since  3  remains  fixed). 

2.4  PRUNING 

“Pruning”  is  a  term  which  we  apply  to  operations  which  result  in  the  removal  of 
pretracks  or  hypotheses  from  the  data  structure.  Its  primary  objective  is  to  limit  the 
number  of  pretracks  and  hypotheses  to  some,  usually  predetermined,  maximum.  The  need 
for  such  a  limit  is  dictated  by  the  available  storage  space  and  also  by  computational  consid¬ 
erations  since  the  algorithm’s  processing  time  depends  on  the  number  of  pretracks  and 
hypotheses.  Aside  from  those  situations  in  which  the  above  maximum  is  likely  to  be  ex¬ 
ceeded  (e.g.,  the  first  “PRUNE”  in  Figure  1),  it  is  also  natural  to  prune  a  hypothesis  or 
pretrack  if  its  probability  is  close  to  one.  (We  shall  see  shortly  that  confirmation  also  results 
n  pruning  pretracks.)  These  account  for  the  second  and  third  set  of  prunings  indicated  in  the 
flow  diagram  of  Figure  1 . 

When  and  What  to  Prune 

When  space  considerations  indicate  that  pruning  is  necessary,  we  are  faced  with  the 
question  of  which  pretracks  or  hypotheses  to  remove.  In  the  absence  of  other  criteria,  the 
most  obvious  procedure  is  to  order  them  according  to  their  probabilities  (scores)  and  prune 
the  least  likely.  This  presumes  that  such  probabilities  are  available.  For  hypotheses,  these 
quantities  may  be  determined  by  the  Bayesian  recursion  (1);  however,  we  have  yet  to 
specify  what  we  mean  by  the  probability  of  a  pretrack.  A  logical  definition  is  provided  by 

expressing  P(T)  in  terms  of  its  conditional  probabilities;  namely,  P(T)  =  £  P(T Ih)P(h).^ 

h 

Since  P(Tlh)  =  1  if  T  e  h  and  equals  zero  otherwise,  we  have 

P(T)  =  POD  (7) 

|hlT €  hf 

Note  that  (7)  is  the  probability  that  the  data  points  of  T  are  associated  with  each 
other  and  that  there  are  no  other  data  points  which  are  associated  with  them.  For  future 
reference  we  also  give  an  expression  for  the  probability  that  the  data  points  of  T  simply 
are  associated, 

P(assoc(T))=  2  P(h)  (8) 

} h IT  c  T' e  h\ 

This  association  occurs  in  all  situations  which  include  T  as  a  sub-pretrack  of  a  pretrack  in 
some  hypothesis.  For  example,  given  the  data  d],  d2  and  d5.  the  event  that  dj  and  d->  are 
associated  (i.e..  P(assoc(T | )))  includes  the  events  T]  =  |d| .  d^f  and  Tt  =  {dj ,  d2-  dsj- .  but 
the  event  T  |  (which  has  probability  P(T | ))  is  disjoint  from  the  event  T2  since  they  never 
both  occur  in  the  same  hypothesis. 


7  From  a  more  general  viewpoint,  all  of  these  probabilities  are  conditioned  on  the  input  data.  This  is 
consistent  with  the  definitions  of  section  2.1  which  are  ail  in  terms  of  the  inputs  dj.  For  a  discussion,  see 
section  3.  Note  that  the  more  general  definitions  of  section  3  use  the  same  notation :  any  potential  conflict 
in  meaning  should  be  deal  from  the  context. 
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Although  the  most  straightforward  procedure  would  be  to  prune  wherever  space  is 
needed  to  accommodate  a  new  pretrack  or  hypothesis;  the  above  strategy,  which  relies  on 
scores  to  determine  which  object  to  prune,  is  not  compatible  with  pruning  during  the 
execution  of  HGEN  T').  Indeed,  expression  (7)  may  not  be  computed  until  all 

hypotheses  h  such  that  Teh  have  been  generated,  which  may  very  well  not  occur  until 
completion  of  HGEN.  Moreover,  the  same  problem  occurs  in  the  scoring  of  hypotheses 
where,  as  shall  be  seen  in  section  2.5,  the  computation  of  P(h')  via  P(h'!h)P(h)  where 
h  -*  h'  relies  on  the  normalization* 


P(h" Ih)  =  1 


(9) 


and  thus  cannot  be  completed  until  all  pretracks  of  the  form  T"  =  T  U  T'  for  T  e  h  have 
been  generated.  The  single  exception  to  these  remarks  occurs  when  the  probability  of 
T  -»  T"  is  zero,  so  that  P(h")  =  0  (and  thus  P(T")  =  0)  regardless  of  any  normalization.  Such 
objects  are  pruned  simply  by  neglecting  to  add  them.  This  accounts  for  the  second  PRUNE 
in  Figure  1 . 

In  view  of  these  remarks,  pruning  to  provide  space  is  done  prior  to  executing  HGEN 
(see  Figures  1  and  9)  and,  hence,  must  release  sufficient  room  for  the  pretracks,  hypotheses, 
and  links  which  are  liable  to  be  generated  during  that  procedure.  Suppose  we  designate  the 
available  space  by  S  (which  is  known  from  equations  (5)  and  (6))  and  the  number  of  objects 
to  be  generated  by  M.  Then  the  situation  is  more  complex  than  simply  removing  M  -  S 
objects  when  M  >  S.  Each  removal  of  a  hypothesis  or  pretrack,  in  addition  to  providing 
space,  changes  the  number  of  hypotheses  and  pretracks  which  will  be  generated  when 
HGEN  is  executed.  For  example,  assume  that  S  =  96  and  the  state  is  such  that  a  new 
primitive  will  result  in  the  generation  of  M  =  100  additional  hypotheses.  If  we  prune  one 
hypothesis  which  contains  five  pretracks.  M  will  be  reduced  to  94  since  that  hypothesis 
could  have  generated  six  new  hypotheses  (cf.  equation  (6)).  Thus,  to  provide  space  it  is 
sufficient  to  prune  that  single  hypothesis;  removing  M  -  S  =  4  hypotheses  would  have  been 
a  gross  overkill. 

To  remedy  the  situation,  we  remove  one  pretrack  or  hypothesis  at  a  time  (plus  any 
implied  prunings  -see  the  subsection  on  remove*)  until  the  potential  number  of  generated 
objects  becomes  less  than  the  available  space.  Each  such  pruning  increases  the  amount  of 
space  and  also  decreases  the  number  of  objects  generated  in  HGEN  according  to  the 
formulae: 


remove  pretrack  T  €  £7  implies 

nhgen:=  nhgen  -  #,<H*(T)  (10) 

ntrack:=  ntrack  -  1  (11) 


*Note  that  although  in  the  absence  of  this  normalization  we  can  order  the  relative  scores  of  h'  and  h”  lor 
hg  -»  h'  and  hg  -»  h",  we  are  not  capable  of  comparing  them  to  the  score  of  a  hypothesis  h'"  which  was 
generated  from  some  other  hypothesis  h]  ;e.g..  hj  -*  h’”  with  hj  ^  hg. 


remove  hypothesis  h  e  h  implies 

nhgen:=  nhgen  -#(T  in  3  n  h)  (12) 

The  variables  nhgen  and  n  track,  which  denote  the  number  of  hypotheses  and  pretracks  to 
be  generated,  respectively,  are  initialized  by  equations  (5)  and  (6).  The  notation  is 
to  be  read  is  replaced  by.  Note  that  in  (1 2)  the  right  hand  quantity  equals  the  number  of 
pretracks  of  S  contained  in  the  hypothesis  h  (which  is  zero  if  T  =  0).  The  reader  is  advised 
that  the  term  “remove”  is  used  in  a  precise  sense  as  described  in  the  next  subsection. 

Pretrack  and  Hypothesis  Removal 

To  remove  a  pretrack  from  the  data  structure,  we  must  adjust  the  links  of  the  net¬ 
work  as  well  as  remove  the  node  corresponding  to  the  pretrack.  This  is  illustrated  in  Fig¬ 
ure  10.  All  the  parents  of  the  removed  pretrack  must  be  linked  to  all  the  children  of  that 
pretrack.  This  process  can  be  facilitated  by  the  inclusion  of  uplinks  to  avoid  a  search  in 
determining  the  parents  of  a  pretrack.  However,  it  should  be  noted  that  such  an  approach 
uses  additional  space  as  well  as  incurring  an  overhead  in  updating  the  second  set  of  links. 

The  removal  of  hypotheses  also  requires  several  data  structure  manipulations.  As 
discussed  in  subsection  2.3  (and  Appendix  A)  hypotheses  are  specified  in  terms  of  the  pre¬ 
tracks  they  contain;  i.e..  by  means  of  the  sets  Jl*{ T).  Thus  removal  of  a  hypothesis  h 
entails;  (a)  removing  the  object  h  and  (b)  removing  h  from  ,#*(T)  for  all  T. 


Figure  10.  Example  of  pretrack  removal. 

The  reader  should  take  care  not  to  confuse  these  data  manipulation  operations, 
namely,  removal  of  pretracks  and  hypotheses,  with  the  general  pruning  procedures 
remove*  which  are  described  in  a  subsequent  subsection.  The  operation  remove* 
follows  any  removal  with  the  further  removal  of  any  empty  hypotheses  and  of  any  pre¬ 
tracks  which  belong  to  no  hypotheses,  a  situation  which  may  arise  from  the  first  removal. 
This  is  necessary  in  order  to  maintain  a  consistent  data  structure  (e.g..  to  avoid  duplication 
of  the  hypothesis  10] ). 
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Pretrack  Denial 


In  the  above  example  (Figure  10),  although  the  pretrack  Tj  2  has  been  removed,  the 
combination  of  its  data  points  still  appears,  as  a  subset,  in  pretracks  Tg  and  Tj  3.  If  we 
should  wish  to  deny  the  association  of  the  data  represented  by  Tj  2,  that  is  of  any  pretrack 
containing  both  pi  and  P2,  we  must  also  remove  Tg  and  T13.  We  make  the  following 
definition: 

To  deny  a  pretrack  set  T  is  to  remove  all  Tj  such  that  TC,Tj. 


Thus  denial  excludes  certain  data  combinations  from  the  graph  of  pretracks;  it  is  a  means  of 
incorporating  negative  information.  In  this  respect  our  definition  is  quite  general.  One  can 
“deny”  a  union  of  primitives  T  regardless  of  whether  T  appears  in  the  graph.  Figure  1 1 
demonstrates  the  result  of  denying  T  \  2  in  the  previous  example.  Note  that  P2  and  p£  have 
disappeared  since  after  denial  of  Tj2  they  are  false  alarms  with  certainty  (i.e.,  they  are  no 
longer  present  in  the  internal  representation  of  any  hypothesis). 


Figure  11.  An  example  of  denial. 


As  a  more  extreme  case,  contrasting  the  concepts  of  removal  and  denial,  consider 
the  situation 


If  we  remove  T2,  we  are  left  with  the  pretrack  T]  =  pj  u  p2  ...  u  pn+2;  however,  if  we  deny 
T2,  we  are  left  with  no  tracks  since  T2  c  Tj.  Thus,  denial  is  often  much  stronger  than 
removal.  Consequently,  if  we  should  find  that  T2  has  a  very  low  probability,  we  should 
remove  it,  not  deny  it.  In  fact,  even  if  the  probability  P(Tt)  is  zero.  P(Tj)  need  not  be 
zero.  This  is  not  inconsistent,  it  merely  states  that  given  the  data  pj  ...  pn+2-  the 


probability  of  pn+j  u  pn+2  being  a  separate  pretrack,  not  associated  with  p|  ...  pn,  is  zero. 
Note  that  equations  (7)  and  (8)  provide  criteria  for  removal  and  denial,  respectively.  Since 
P(assoc(T))  >  P(T),  the  condition  P(T)  ~  0  is  weaker  than  P(assoc(T))  ~  0,  just  as  removal 
is  weaker  than  denial. 

This  discussion  does  not  mean  that  denial  is  useless  as  a  pruning  tool.  One  should 
certainly  beware  of  dangerous  side  effects  such  as  the  possibly  undesirable  elimination  of 
T i  in  the  above  figure;  however,  that  example  was  admittedly  a  worst  case.  More  typically 
the  track  space  would  also  include  some  other  pretrack  which  approximates  T ) ;  for 
instance. 


Now,  the  denial  of  Tt  leaves  us  with  T3  =  pj  U  ps  ...  u  pn  which  is  a  reasonable  approxi¬ 
mation  toTj  .  thus  its  effect  is  less  drastic. 

As  a  final  remark,  we  note  that  in  programming  a  procedure  for  denial,  one  must  be 
careful  not  to  neglect  cases  of  the  type 

P3  I'J  I’X  P*  Pj 

/\  /!  \  / 


Since  T9  =  P4  u  pg  c  T|q.  Tjq  has  been  removed.  Recall  that  Tj  c  Tj  does  not  necessarily 
imply  that  Tj  is  a  descendent  of  Tj  in  the  pretrack  graph.  A  reasonable  algorithm  for  the 
denial  of  T  might  be 

(i)  find  the  set  of  primitives  p^  such  that  T  =  u  pj. 

A  k 

(ii)  find  SD(p|<)  =  set  of  descendents  of  p^  for  each  k 

(iii)  remove  all  pretracks  in  n  SD(Pk) 


Note  that  a  benefit  of  the  graph  structure  is  the  ability  to  implement  procedures  such  as 
SD  or  the  determination  of  the  p^,  recursively.  For  example, 

procedure  SD(T)  {find  descendents  of  Tj 
put  S  =  null  set; 
for  all  children  Tj  of  T  DO 
put  S  =  S  u  SD(Tj); 
put  SD(T)  =  S 

Still,  whenever  possible,  it  is  more  efficient  to  introduce  constraints  on  the  association  of 
primitives  using  reports  at  the  time  of  input  rather  than  a  denial  later. 

Confirmation  and  Affirmation 

Confirmation  and  affirmation  may  be  considered  the  positive  information  counter¬ 
parts  of  removal  and  denial.  To  confirm  a  pretrack  is  to  assert  that  it  appears  in  every 
hypothesis;  i.e.,  that  P(T)  =  1 .  This  is  equivalent  to  requiring  that  the  primitives  of  T 
appear  only  in  the  pretrack  T.  More  precisely, 

to  confirm  a  pretrack  T  is  to  remove  all  Tj  #  T  such  that  Tj  n  T  ^  <j>. 

An  example  of  confirmation  appears  in  Figure  12. 


Figure  12.  Examples  of  confirmation  and  affirmation. 
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Similarly,  affirmation  of  a  pretrack  T  asserts  that  the  primitives  of  T  are  associated 
with  probability  one;  i.e..  that  P(assoc(T))  =  1 .  The  effective  result  is  a  graph  in  which  all 
appearances  of  subsets  of  T  are  actually  equal  to  T.  Formerly,  we  define 

to  affirm  a  pretrack  T  is  to  remove  all  Tj  ^  T  such  that  Tj  n  T  #  (T  or  0). 

Affirmation  is  also  illustrated  in  Figure  12.  Note  that  confirmation  of  T  may  be  imple¬ 
mented  by  removing  all  descendents  of  T  and  then  affirming  T. 

The  effects  of  the  four  pruning  operations  studied  are  summarized  in  Table  2  below. 


Table  2.  Summary  of  effects  of  remove,  deny,  confirm,  and  affirm. 

Remove*,  Deny*,  etc. 

Up  to  this  point  our  description  of  pruning  operations  has  dealt  with  the  removal 
of  only  pretracks  or  only  hypotheses  and  has  neglected  the  possibility  of  interaction 
between  these  two  objects.  For  example,  the  removal  of  a  hypothesis  may  result  in  pre- 
tracks  which  belong  to  no  hypotheses.  We  certainly  wish  to  dispose  of  such  pretracks.  (The 
software  may  even  rely  on  the  existence  for  every  T  of  at  least  one  hypothesis  h  such  that 
Teh.)  Even  worse,  the  removal  of  a  pretrack  T  has  the  side  effect  of  removing  T  from 
every  h  in  Jf*(T).  Thus,  h-  h  -  [T 1 .  and  the  primitives  in  T  metamorphose  into  false 
alarms.  This  may  produce  duplicate  hypotheses,  and  certainly  affects  the  score  of  h  in  a 
manner  we  are  not  prepared  to  handle. 

Rather,  we  visualize  the  removal  of  a  pretrack  T  as  setting  the  probability  of  T  to 
zero;  namely,  the  probability  of  T  occurring  in  any  hypotheses  is  zero.  Hence,  along  with 
the  removal  of  T,  we  remove  all  h  such  that  Teh.  No  scoring  problems  result  since  we 
effectively  have  set  P(h)  =  0,  and  this  is  taken  care  of  by  renormalizing  by  equation  (2) 

(cf.  Appendix  B).  We  distinguish  those  operations  which  take  into  account  the  entire 
structure  of  pretracks  and  hypotheses  by  a 

The  procedure  remove *{ h)  is  defined  by: 

To  remove*  a  hypothesis  h, 

(i)  remove  h  and  then 
(ii)  remove  all  T  such  that  ,$f*(T)  =  0. 

Observe  that  removing  T  for.#*(T)  =  0  has  no  side  effects  on  the  hypothesis  structure 
inasmuch  as  T  no  longer  belongs  to  any  hypothesis. 

Similarly, 

To  remove*  a  pretrack  T.  execute  remove*( h)  for  all  h  e  .$(*(T). 
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Note  that  T  itself  gets  removed  by  the  remove*  of  the  last  h  in  J(*(T)  since  at  that  point 

•W*(T)  =  4>- 

The  operations  deny  *,  confirm*,  and  affirm*  are  defined  by  replacing  remove  with 
remove*  in  the  definitions  of  deny,  confirm,  and  affirm,  respectively.  In  view  of  the  above 
definition  of  remove*), T)  in  terms  of  remove*^ h),  we  observe  that  all  these  pruning  proced¬ 
ures  can  be  defined  in  terms  of  remove*  of  hypotheses.  Consequently,  the  scoring  effects 
of  the  operations  are  completely  determined  by  that  of  remove*(h).  We  also  find  that 
these  pruning  operations  are  most  easily  visualized  when  placed  in  the  context  of  data 
partitions;  i.e.,  hypotheses  (see  Table  3  below). 

It  is  interesting  to  note  that  remove*  and  confirm*,  as  well  as  deny*  and  affirm*, 
are  dual  operations  (cf.  Table  3).  Also,  since  P(assoc(T))  >  P(T),  the  criterion  P(T)  ~  1  is 
stronger  than  P(assoc(T))  ~  1  while  P(T)  ~  0  is  weaker  than  P(assoc(T))  ~  0.  These  rela¬ 
tions  correspond  to  the  fact  that  confirm  is  strong  (i.e..  stronger  than  affirm)  while  remove 
is  weak  (i.e.,  weaker  than  deny).  Thus,  the  duality  extends  to  the  relation  weak  «•  strong. 


Operation  on  T 

Final  State 

Satisfies  for  all  h 

Pruning 

Criterion 

remove * 

T<?  h 

P(T)  small 

confirm* 

P(T)  large 

deny* 

3  Tj  e  h  such  that  TCTj 

P(assoc(T))  small 

affirm* 

3  Tj  €  h  such  that  T  C  Tj 

P(assoc(T))  large 

Table  3.  Summary  of  four  pruning  operations  reflecting  their  duality. 


Suboptimality  Considerations 

The  removal  of  a  pretrack  which  has  zero  probability  is  never  deleterious;  however, 
it  is  inevitably  necessary  to  also  prune  pretracks  of  non-zero,  albeit  low.  probability.  This 
suboptional  procedure  can  lead  to  difficulties  inasmuch  as  the  premature  removal  of  a  pre¬ 
track  may  limit  future  data  associations.  As  a  simple  example,  consider  the  initial  situation 


Pi 


Upon  reception  of  a  third  primitive  pj  this  evolves  to 


pi  pj  p; 

?  T  T 


h 


tj 


i 


i 


5 


* 
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If  we  now  remove  T  j .  we  find 


I’ I  l’3 


i  1  ! 

>3  ^ 


On  the  other  hand  if,  previous  to  receiving  P3,  we  had  removed  T j  and  then  input  p^.  we 
would  have  obtained 

t’3 


?  ? 

>3  i: 


Thus,  by  the  perhaps  hasty  decision  to  remove  T  j  we  lose  the  capability  of  generating  the 
pretrack  T4  =  P|  u  p^. 

One  might  argue  that  p|  is  not  a  highly  reliable  data  point  anyway  since  otherwise 
the  probability  of  T  j  would  have  been  higher,  and  it  would  not  have  been  removed.  In  that 
case,  T3  =  P3  could  be  considered  a  good  approximation  to  T4  *  P3  u  p] .  However,  it  is 
not  difficult  to  imagine  more  complex  examples  for  which  such  justifications  appear  less 
plausible.  There  are  two  generic  cases  which  may  arise.  First,  we  may  have  two  pretracks, 

T  |  and  Tt  present,  but  because  of  early  pruning,  there  is  no  pretrack  approximating  T]  uTr 
Even  though  the  more  recent  data  may  be  sufficient  to  associate  T |  and  T2.  such  a  pretrack 
will  never  be  generated  by  HGEN.  One  can  suggest  implementing  “fusion”  operations  to 
remedy  the  problem:  however,  this  would  require  a  consistent  (i.e..  with  section  2.5)  means 
of  computing  the  probability  corresponding  to  the  fused  track,  as  well  as  a  computationally 
efficient  procedure  for  determining  which  tracks  to  fuse. 

The  other  case  is  that  in  which  T3  =  T]  u  T2  appears,  but  T j  and  Tt  have  been 
pruned.  As  more  data  are  procured,  it  may  become  more  and  more  evident  that  T 1  and 
Tt  should  be  separate  pretracks;  i.e.,  that  they  are  associated  with  distinct  targets. 

(Actually,  without  some  additional  algorithmic  clues,  the  only  visible  manifestation  of 
this  situation  will  be  a  decrease  in  the  probability  of  T3  as  the  association  of  Tj  and  Tt 
becomes  less  likely.  However,  if  T  |  and  T^  had  been  retained  as  separate  pretracks,  their 
probabilities  would  be  increasing.)  Note  that  the  problem  really  is  a  question  of  the  degree 
of  an  approximation  since  new  primitives  corresponding  to  the  two  targets  are  constantly 
forming  new  pretracks  which  in  turn  have  the  opportunity  to  grow  during  the  evolution 
of  the  scenario  and  thus  approximate  (possibly  poorly)  T |  and  Tt-  To  combat  these 
difficulties,  we  can  postulate  a  pretrack  "separation”  operation.  Observe,  however,  that 
such  a  procedure  (as  in  the  case  of  fusion)  represents  a  type  of  backtracking  and  conse¬ 
quently  tends  to  tax  the  recursive  structure  of  the  algorithm. 
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Although  one  can  continue  to  propose  countless  schemes  to  mitigate  the  above 
difficulties,  any  algorithm  short  of  treating  the  entire  combinational  problem  will  neces¬ 
sarily  be  suboptimal.  An  obvious  consequence  is  that  the  results,  namely,  the  output 
probabilities,  will  depend  on  the  order  in  which  the  data  are  input.  (Even  if  these 
probabilities  are  considered  to  be  conditioned  on  the  prunings  as  in  Appendix  B.  exactly 
which  pretracks  are  pruned,  and  hence  which  probabilities  are  output,  will  depend  on  the 
input  order.)  Thus,  an  appropriate  strategy  is,  whenever  possible,  to  enter  the  most  reliable 
or  useful  data  first  so  that  early  pruning  based  on  insufficient  information  can  be  minimized. 

2.5  SCORING 

Our  basis  for  scoring  is  the  recursion  (1),  which  we  now  derive.  Let  h-»  h'.  Inas¬ 
much  as  the  new  hypothesis  h'  is  generated  by  a  unique  hypothesis  h  from  the  previous 
stage,  the  event  h  and  h'  is  the  same  as  the  event  h' .  Thus,  we  may  write  (Bayes'  rule) 

P(h’)  =  P(h'.h) 

(13) 

=  P(h'ih)P(h) 

Substituting  the  event  (h\  d')  forh'.*  and  using  the  relation  P(h’,d’)  =  P(h'ld’)P(d’).  we 
obtain 


P(h'ld') 


P(h',dlh)P(h) 

P(d') 


(14) 


Equation  (14)  clearly  remains  valid  if  the  probability  measure  P(*)  is  replaced  by  the 
probability  P(*  \{D)  conditioned  on  the  past  data.  (Equivalently,  divide  both  sides  of  ( 1 4) 
by  P(iD).)  The  result  is 


P(h'ld',fl>) 


P(h',d'lh,3))P(hl<D) 

P(d’l<0) 


(15) 


that  is,  equation  (1). 

We  shall  abbreviate  this  to 

P(h')  =  c  P(h',d'lh)P(h)  (16) 

where  the  conditional  dependencies  on  d'  and  the  past  data  3)  have  been  suppressed  to 
simplify  the  notation,  and  c  is  determined  by 

c=pP(h’,d'lh)P(h)J  (17) 


^  As  above  (h',d')  is  dearly  equivalent  to  the  event  (h.h'.d  ). 
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It  is  important  to  note  that  in  writing  ( 16)  we  have  made  the  now  implicit  assumption  that 
h  generates  h'.  Also,  equations  (15)  and  (17)  remain  valid  if  d'  is  replaced  by  a  primitive 
p\  however,  to  avoid  possible  notational  confusion  later  (using  a  capital  “P”  in  section  3 
to  denote  a  primitive  function  would  conflict  with  its  use  as  a  probability  measure),  we 
retain  the  symbol  d'. 

Let  us  now  suppose  that  h  generates  h'  by  T  -  T".  We  may  then  express  the  condi¬ 
tional  probability  of  h'  in  terms  of  the  transition  T-*T"=Tu  jd'  { ;  that  is,  in  terms  of  the 
probability  of  d'  being  associated  with  the  track  T.  Mathematically,  we  have 

P(h',d'lh)  =  P(T"  =  T  u  j  d'}  IT.h)  (18 

(The  events  (T,h)  and  (h)  are  identical  since  Teh.  Similarly.  T  •*  T"  and  h  determines 
h'.)  It  should  be  kept  in  mind  that  P(T"  IT.h).  which  is  the  conditional  probability  of  the 
pretrack  T",  includes  the  probability  of  the  value  of  the  measurement  d’  as  well  as 
of  its  association  with  T.  The  probability  of  just  association  would  have  to  be  written 
P(T"ld'.T,h). 

If  the  right  hand  side  of  ( 1 8)  were  independent  of  h  (i.e..  if  the  measurement  d' 
and  its  association  with  T  were  only  dependent  on  T),  then  ( 1 6)  and  ( 1 8)  would  provide 
a  very  efficient  means  of  computing  P(h')  (cf.  [4] ).  This  is  illustrated  in  Figure  1 3.  Not 
only  is  this  scheme  a  natural  extension  of  the  hypothesis  generation  algorithm 
HGEN  (ST .  Jl,  T'),  but  the  bulk  of  the  computation  (i.e.,  determining  P(h',d'|h)  =  P(T”|T)) 
is  only  performed  once  for  each  new  pretrack  T"  rather  than  once  for  each  hypothesis  h'. 
Since  each  new  pretrack  T"  may  appear  in  many  hypotheses,  this  can  represent  considerable 
savings. 


Figure  13.  Computation  of  P(h')  when  equation  ( 18)  is  not  dependent  on  h. 


Unfortunately,  (18)  usually  does  depend  on  h.  For  example,  the  probability  of  a 

false  alarm  (h  -  h)  or  of  a  new  track  (h  — h')  may  depend  on  the  number  of  targets 

0.1 

present;  i.e.,  on  the  number  of  pretracks  in  h.  Furthermore,  although  the  probability  of 
T"  =  T  u  jd'  |  given  that  d'  is  not  a  FA  (false  alarm)  or  NT  (new  target)  may  be  independent 
of  h,  one  still  has  to  know  P(NT)  and  P(FA)  in  order  to  compute  P(T"  IT.h) 


P(T"  IT.h) 


P(T*IT,h.  not  NT,  not  FA) 
1  -  P(NTih)  -  P(FAIh) 


(19) 


and  the  right  hand  side  depends  on  h  even  if  the  numerator  does  not. 

However,  we  can  still  retain  the  advantages  of  Figure  13  by  isolating  those  computa¬ 
tions  which  depend  on  h.  Specifically,  it  is  often  possible  to  express  P(T"  IT.h)  in  the  form 
(cf.  equation  (19)) 

P(T"IT.h)  =  chP(T"!T)  CO) 

where  the  dependency  on  h  only  enters  through  the  constant  cjv  (In  fact,  our  models  and/ 
or  heuristics  frequently  only  have  sufficient  detail  to  construct  P(T”  IT.h)  up  to  some  con¬ 
stant  factor;  i.e..  to  determine  P(T''IT);  see  section  4.)  The  constant  c^  is  then  determined 
by  the  normalization  relation+ 

/  S  P(h'.d'ih)  =  1  Cl) 

>d'  {h'lh-h'} 

which  in  view  of  ( 1 8)  and  ( 20)  takes  the  form 


ch 


/  £  , 

Jd'  }T"IT  e  h,T-T"} 


P(T”  IT)  =  1. 


Let  us  define 
7(T 


■T,s  / 
J  A' 


P(T"  IT) 


which  is  only  a  function  of  the  pretracks  T  and  T".  Then  we  have 


£  7(T"-T) 

IT  e  h,T-T"} 


I 


(22) 


(23) 


t  Recall  that  d'  typically  assumes  a  continuous  set  of  values.  If  not.  appropriate  parts  of  the  (possibly 
multiple)  integral  should  be  replaced  by  sums. 


As  a  result,  the  procedure  for  the  computation  of  (20)  via  P(T"IT),  and  (22)— (23)  is 
somewhat  more  complex  than  that  of  Figure  13;  however,  the  most  time  consuming  com¬ 
putations- namely,  P(T",T)  and  -y(T"  ,T)— still  remain  a  function  of  the  pretracks  aione,  not 
the  hypotheses.  A  flow  diagram  appears  in  Figure  14.  It  is  sufficiently  general  to  accommo¬ 
date  almost  all  models  of  P(h'.d'lh). 

For  an  overview  of  the  algorithm  and  its  scoring,  we  return  to  Figure  1 .  The  dashed 
box  represents  HGEN  (2\  J( ,  T').  During  that  procedure,  a  pretrack  scoring  procedure  is 
executed  to  compute  and  store  P(T"IT)  and  7(T".T)  (i.e.,  the  first  large  box  in  Figure  14). 
Note  that  the  box  SCORE  NEW  PRETRACK  in  Figure  1  refers  to  this  procedure  and  not 
to  the  computation  of  P(T")  which  according  to  equation  (7)  may  only  be  computed  after 
completing  the  scoring  of  all  hypotheses.  Finally,  after  all  hypotheses  have  been  generated 
and  pretracks  scored  (up  to  normalization),  we  introduce  the  normalization  constants  c^ 
and  c+  in  the  box  titled  SCORE  HYPOTHESES  (i.e.,  second  large  box  in  Figure  14).  In 
the  context  of  reports,  these  procedures  occur  within  the  large  lower  box  of  Figure  9. 


+  c  is  not  necessary  for  determining  the  relative  scores  of  hypotheses,  but  c|,  cannot  be  omitted  since 
it  is  a  function  of  the  generating  hypothesis. 


For  all  Te  3  DO: 


3.  COMMENTS  ON  THE  BAYESIAN  APPROACH  AND  A 
REDEFINITION  OF  HYPOTHESIS 


To  this  point  we  have  been  somewhat  cavalier  in  our  use  of  probabilistic  termi¬ 
nology;  our  definitions  have  been  structured  on  the  received  data,  and  probabilities  have 
been  discussed  without  attention  to  the  underlying  spaces.  Such  a  treatment  entailed 
absolutely  no  loss  of  rigor  in  the  development  of  the  algorithmic  framework,  and  in  fact 
simplified  the  discussion  by  avoiding  theoretical  digressions.  However,  as  soon  as  one 
attempts  to  model  the  quantities  (P(h'.d'ih)  which  appear  in  the  scoring  mechanism  (cf. 
section  2.5  and  section  4),  certain  inadequacies  in  our  original  definitions  begin  to  appear. 
This  section,  although  it  does  not  pretend  to  fully  remedy  the  matter,  does  attempt  to 
address  several  theoretical  issues  which  are  conceptually  important  and  seemingly  not 
without  practical  implications. 

In  particular,  one  must  exercise  a  certain  caution  in  the  definition  of  hypothesis. 
We  picture  a  number  of  targets,  each  described  by  a  set  of  parameters  (state  variables), 
the  totality  of  which  we  shall  represent  by  a  single  vector  x,  the  so-called  state  of  nature. + 
A  set  of  N  vector  measurements  dj  =  Dj(x.co)  are  made,  each  associated  with  a  specific 
target.  Both  the  association  and  the  value  dj  depend  on  random  influences  which  we 
combine  into  a  single  sample  space,  the  points  of  which  are  designated  by  go.  If  so  de¬ 
sired.  the  total  state  may  also  be  considered  a  random  variable  x(co)  as.  for  example,  in  the 
assignment  of  apriori  target  densities.  (Modeling  the  distribution  of  the  random  variable 
Dj  is,  of  course,  part  of  our  problem.)  Given  the  set  of  measurements  dj.  we  wish  to  group 
the  measurements  according  to  target.  Thus,  the  immediate  temptation  is  to  define  a 
hypothesis  as  a  partition  of  the  values  dj.  i  =  1 . N. 

Although  there  are  no  logical  impediments  to  such  a  definition,  there  are  some 
conceptual  problems.  Under  that  definition,  we  certainly  feel  comfortable  speaking  of 

P(H  =  hIDj  =  dj  i  =  1 . N),  the  probability  of  hypothesis  h  given  the  measurements  dj.** 

It  is  equal  to  the  ratio  of  the  probability  of  the  set  of  all  go  which  satisfy  Dj(x.Go)  =  dj  as 
well  as  the  target-measurement  relation  prescribed  by  h  to  the  probability  of  the  set  of  all 
co  such  that  Dj(x,co)  =  dj.  However,  the  corresponding  interpretation  of  P(Dj  =  dj  i  =  1 . 

....  Nlh)  is  intuitively  disturbing.  We  find  that  h  is  undefined  except  for  an  explicit  d; 
i.e.,  we  cannot  talk  of  h  unless  we  are  given  d+t+  Mathematically,  this  means  that 
P(D  =  dlh)  is  non-zero  only  if  li  refers  to  the  explicit  set  of  values  d.  in  which  case 
it  is  1 .  Simply  put.  under  the  above  definition,  we  have  P(H  =  h.  D  =  d)  =  P(H  =  h). 

What  we  really  seem  to  desire  P(D  =  dlh)  to  mean  is  "the  probability  that  a 
set  of  N  measurements  will  have  the  values  dj.  given  that  they  come  from  an  already 
prescribed  assignment  to  targets  (labeled  h)."  This  is  a  probability  distribution  which 
we  typically  feel  at  ease  modeling  isee  equations  (31 )— ( 33 ).  for  example),  and  we  cer¬ 
tainly  expect  it  to  be  a  non-trivial  function  of  d.  A  bit  of  thought  reveals  that  this  con¬ 
cept  translates  into  a  definition  of  hypothesis  as  a  partition  of  the  set  of  measurement 


’’’Thus  we  might  have  x  =  (x  j  ,xi,  ...)  where  xj  =  (Xj  [ ,  Xj->, ...). 

^Here  H  is  the  random  variable  on  co  whose  value  is  the  partition  of  the  dj  =  Djtx.  to)  corresponding  to 
the  set  of  targets. 

t+tpor  convenience,  when  the  context  is  clear,  we  abbreviate  expressions  of  the  form  "Dj  =  dj  for 
i  =  1 . N"by"D  =  d." 


functions  Dj  rather  than  a  partition  of  the  measurements  themselves  (i.e.,  dj).  This  point  of 
view  also  corrects  a  second  defect;  namely,  that  the  previous  development  does  not  fit  into 
classical  decision  theory  where  the  space  of  hypotheses  parameterizes  a  family  of  probability 
distributions  on  the  measurement  space  (11]). 

Let  us  now  formalize  this  definition  of  hypothesis.  Assume  that  we  are  given  a  set 
of  N  measurement  functions  Dj,  i  =  1, ....  N.  Usually,  except  for  the  identifying  subscript, 
these  functions  will  be  identical;  the  components  of  Dj  are  designed  to  contain  all  the  in¬ 
formation  which  is  to  be  derived  from  the  measurement.  For  example,  we  may  have 
Dj(x,co)  =  (T(x,co),  K(x,co),  G(x,co));  where  T  is  the  time  of  the  measurement,  K  is  an 
integer  indicating  the  type  such  as  a  bearing  or  frequency,  and  G  is  the  value  of  the  measure¬ 
ment.  Of  course,  we  must  have  some  apriori  method  of  physically  identifying  the  functions; 
i.e.,  of  fixing  the  labels  “i.”  A  natural  means  of  doing  this  is  to  pick  Dj  to  be  the  i1*1  meas¬ 
urement  received  at  some  central  location.  This  ordering  of  the  data  entails  no  loss  of 
generality;  it  merely  corresponds  to  choosing  a  coordinate  system  by  which  we  may  refer¬ 
ence  the  hypotheses.  It  contrasts,  for  example,  with  the  case  in  which  the  times  of  measure¬ 
ment  tj  are  used  to  label  the  D’s  and  the  functions  are  defined  to  have  the  form 
Dj.(x,cc)  =  (K(x,co),  G(x,cj)){..  In  such  a  framework  one  cannot  usefully  speak  of  the 

probability  that  a  measurement  occurs  at  time  t  given  a  hypothesis  h  (i.e..  given  a  parti¬ 
tion  of  the  Dj.’s);  for  example,  P(G  =  glh)  would  contain  information  whereas 
P(Tj  =  tjlh)  would  not,  since  h  would  already  imply  that  Tj  =  tj. 

We  now  define  a  hypothesis  as  a  partition  of  the  set  of  functions  Dj.  It  is  seen  that 
the  space  of  hypotheses  is  in  one-to-one  correspondence  with  the  partitions  of  the  N  integers 
1,  ... ,  N.  Our  definition  depends,  of  course  on  a  choice  of  a  class  of  functions  Dj  and  the 
number  N.  As  N  varies,  we  obtain  a  series  of  nested  problems  (see  Appendix  B).  Note  that 
to  each  sample  point  oo  corresponds  a  unique  hypothesis  H(co)  which  is  the  partition  of  the 
functions  Dj  corresponding  to  grouping  Dj(x,co)  according  to  target.  (Recall  that  x.co 
specify  the  target-measurement  relationship  as  well  as  the  value  dj.)  It  is  also  seen  that, 
conditioned  on  the  measurements,  this  definition  of  hypothesis  coincides  with  that  of 
section  2.1 ;  that  is,  both  definitions  correspond  to  the  same  set  of  points  in  the  sample 
space  once  d  is  given.  Analytically,  we  express  this  by  jco|  H(cu)  =  h,  D(x,co)  =  d  [  = 
{colpartition  of  D  =  h,  D(x,co)  =  dj  =  {wi partition  of  d  =  h.  D(x.co)  =  d| .  However,  if  one 
models  the  necessary  distributions  (e  g..  P(H'  =  h',  D  =  d'|H  =  h);see  section  4)  through  the 
intermediary  P(D  =  d|H  =  h),  predicated  on  the  assumption  that  D  has  a  non-trival  distribu¬ 
tion  given  h,t  then  h  must  be  defined  in  terms  of  a  family  of  functions  Dj  which  are  specified 
without  supplying  particular  values  dj. 

Thus,  the  more  general  definition  of  hypothesis  presented  in  this  section  enables 
us  to  consider  P(D  =  dlh)  and  with  it  the  possibility  of  a  maximum  likelihood  approach  to 
the  problem;  namely,  the  choice  of  a  hypothesis  h  by  maximizing  P(dlh)  over  h.  This  tech¬ 
nique  is  useful  in  the  absence  of  any  knowledge  of  the  apriori  probability  P(H  =  h)  or  in  the 
face  of  analytical  difficulties  in  modeling  this  distribution.  Relative  to  Bayesian  methods, 
it  is  equivalent  to  setting  P(H  =  h)  to  a  constant  independent  of  h.  t  There  is  a  tendency 


^For  example,  one  usually  assumes  that,  even  given  that  a  measurement  comes  from  a  specific  target,  its 
value  is  still  a  random  quantity  as  a  consequence  of  measurement  noise. 

*P(H  =  hid)  =  P(D  =  dlh)P(H  =  h)/P(D  =  d). 
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in  this  situation  to  view  H  as  a  non-random  variable;  i.e.,  as  a  parameter  for  a  set  of 
hypotheses  which  constitute  possible  states  of  nature,  one  of  which  is  reality.  However, 
from  the  previous  discussion,  we  observe  that  it  is  very  difficult  conceptually  to  separate 
the  probabilistic  mechanism  behind  H  from  that  of  the  measurements  d.  In  fact,  P(H  =  h) 
must  be  defined  as  a  marginal  distribution  of  P(h,d);  namely, 

P(H  =  h)  =  |co|H(co)=hf  =  /  P(h.d) 

-'d 

Thus,  it  appears  that  if  we  are  forced  to  use  heuristic  methods,  as  is  almost  surely  the  case, 
it  may  be  deceptive  (i.e.,  inconsistent  with  our  other  intuitive  concepts  such  as  P(dih)  and 
the  definition  of  h)  to  picture  h  as  a  deterministic  parameter  of  nature  with  no  apriori 
distribution.  This  seems  to  indicate  that  it  may  be  more  appropriate  to  take  a  Bayesian 
point  of  view,  at  least  with  respect  to  hypotheses. 

Let  us  now  turn  our  attention,  briefly,  to  x.  Typically,  it  is  this  quantity  that  we 
ultimately  wish  to  determine,  namely,  the  number  of  targets  present  and  their  states.  The 
idea  of  a  hypothesis  or  a  grouping  of  measurements  according  to  source  is  only  introduced 
as  an  intermediate  concept  useful  in  estimating  x.  Here  the  feasibility  of  the  two  points  of 
view  (i.e.,  likelihood  and  Bayesian)  seems  to  be  without  question:  the  state  x  may  be  con¬ 
sidered  either  a  nonrandom  variable,  or  a  random  sample  out  of  an  ensemble  of  states  which 
nature  at  various  times  assumes  with  some  apriori  probability.  Nevertheless,  we  shall  see 
below  that  an  ability  to  distinguish  between  targets  almost  always  involves  the  implicit 
assumption  of  an  apriori  distribution  for  x. 

Suppose  that  our  measurements  are  positions  and  they  are  perfectly  accurate.  Fur¬ 
ther,  suppose  we  obtain  two  measurements,  pj  at  t]  and  P2  at  t2  where,  for  example,  t] 
and  t2  are  a  minute  apart  and  pj  anci  P2  are  separated  by  100  feet."*”  Then  we  are  much 
more  likely  to  conclude  that  we  are  observing  a  single  target  (moving  at  a  speed  of  about 
1  knot)  than  two  targets  separated  by  about  100  feet  (more  precisely,  separated  by 
100  +  |t2  -  t  j  |v  where  v  is  their  relative  velocity).  In  other  words,  we  seem  to  feel  that 
a  close  proximity  in  space  and  time  implies  association.  Conversely,  this  concept  of 
association  implies  an  apriori  probability  that  the  targets  are  spread  out;  for  example,  in 
the  absence  of  any  information,  we  might  assume  that  they  are  evenly  distributed. 

Perhaps  a  more  detailed  example  is  on  order.  Suppose  that  there  are  two  targets  in 
a  surveillance  area  consisting  of  fifty  region,  which  correspond  to  the  resolution  of  our 
sonar.  Let  the  apriori  probability  that  either  target  is  in  a  particular  region  be  1/50.  Fur¬ 
thermore,  we  assume  that  if  both  targets  are  in  the  same  region,  a  sonar  return  is  equally 
likely  to  be  from  either  of  the  targets.  Given  two  measurements  xj  and  X2-  both  indicating 
targets  in  one  of  the  regions,  say  Rjg.  what  is  the  probability  that  those  measurements  are 
associated  with  a  single  target?  Since  xj  is  associated  with  one  of  the  targets,  we  may 
without  loss  of  generality  label  that  as  “target  1 .”  Since  we  know  that  X2  is  from  region 
R)9,  the  probability  that  X2  is  from  target  2  is  given  by: 

P(X2  is  from  target  2 1 target  2  in  R|g)P(  target  2  in  R  |  q ) 


*The  measurements  in  this  example  are  visualized  as  active  sonar  measurements  of  ship  positions. 


which  is  (1/2)  (1/50)  =  1/100.  Similarly,  it  follows  that  the  probability  that  x->  is  from 
target  1  (i.e.,  that  x\  and  xi  are  associated)  is  1  -  1/100  =  99/100.  Hence,  we  see  that 
in  this  example  a  uniform  apriori  target  distribution  supports  the  principle  of  association 
by  proximity.  Thus,  even  though  the  apriori  distribution  is  uniform,  it  plays  an  important 
role  in  our  conclusions.  Furthermore,  we  are  alerted  that  apparently  innocuous  assumptions 
on  apriori  distributions  can  have  significant  consequences. 

In  summary,  in  this  section  we  have  attempted  to  unambiguously  define  our  prob¬ 
lem  —  i.e.,  the  notion  of  hypothesis*  -  and  to  point  out  the  significance  of  various  probability 
distributions  so  as  to  help  bridge  intuition  and  theory.  All  of  this  is  done  in  the  hope  that 
it  will  prevent  the  inadvertent  introduction  of  inconsistencies  into  our  heuristic 
constructions. 


+The  comments  in  this  section  clearly  also  apply,  with  little  or  no  modification,  to  pretracks  which  may 
be  defined  as  subsets  of  the  set  of  functions  j  D| .  ...  D;\  }. 
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4.  MODELING 


The  determination  of  the  quantities  P(  h'.d'lh)  of  equation  (16)  constitutes  the 
critical  link*  between  the  algorithm  and  the  environment.  We  begin  with  a  discussion 
intended  to  establish  a  general,  if  somewhat  vague,  basis  for  a  physical  interpretation  of 
these  probabilities.  It  is  also  hoped  that  this  will  communicate  to  the  reader  some  feeling 
for  the  author’s  conceptualization  of  the  modeling  process  and.  hence,  the  meaning  of 
P(h',d|h).  It  should  be  noted  that  the  algorithm  (BAYR)  developed  in  this  report  was 
originally  conceived  in  an  ocean  surveillance  context  which,  consequently,  flavors  some 
of  the  terminology  and  examples. 

In  order  to  be  specific,  we  also  present  a  detailed  model  for  the  computation  of 
P(h'.dlh)  in  the  case  of  bearings-only  tracking.  This  model  was  used  as  a  first  test  of  the 
general  data  association  framework  which  has  been  established  in  the  previous  sections. 

We  observe  that  even  this  relatively  simple  model  confronts  serious  conceptual  issues,  and 
that  the  solutions  which  we  have  chosen  are  by  no  means  unique  or  optimal.  The  develop¬ 
ment  of  more  elaborate  models  and  the  inclusion  of  more  general  data  is  beyond  the  scope 
of  the  present  report. 

First,  we  recall  that  P(h’.d'lh)  is  a  shortened  notation  for  P(h'.d'|h.3)):  i.e..  all  our 
formulae  are  conditioned  on  the  past  data.  3).  Also  by  convention  (see  section  2.5).  the 
conditioning  of  h'  on  h  is  assumed  to  imply  that  h  generates  h'.  More  precisely,  h'  is  either 
a  false  alarm  (h  -  h)  or  determined  by  the  generation  of  a  pretrack  (h  h').  T"  =  T  U  }D'} 

where  D'  is  the  measurement  which  gave  rise  to  the  value  d’.  Note  that  T  may  be  <j>.  in  which 
case  we  have  a  new  pretrack.  Combining  these  remarks,  we  characterize  P(H  =  h'.  D'  =  d'ih) 
as  the  probability  that  (i)  the  causal  relationship  of  D'  to  the  previously  postulated  sources 
h  (i.e.,  pretracks  in  h)  is  described  by  h  -*  h'  and  (ii)  the  measurement  D'  yields  the  value  d'. 

Of  course,  the  most  amgibuous  part  of  the  above  description  is  still  the  word  “probability  .” 

Formally,  (i)  and  (ii)  may  be  expressed  by  the  decomposition 


P(h'.d'lh)  =  P(d'|h'.h)P(h'|h) 
=  P(d'|h')P(h'lh) 


(24) 


The  first  term  P(d'lh').  which  corresponds  to  (ii).  appears  conceptually  tractable  and 
in  many  treatments  ([4]-(7] )  is  actually  the  motivation  behind  the  decomposition  (24).  If 
we  suppose  that  supplying  h'  is  equivalent  to  identifying  the  source  of  the  measurement 
D'  =  d'  and  further  that  the  past  data  3)  is  sufficient  to  approximate  the  state  of  that  source 
or  at  least  to  supply  a  probability  distribution  for  the  state  (see  next  subsection),  then  it 
is  not  unreasonable  to  expect  to  model  the  probability  distribution  of  the  value  of  that 
measurement  (i.e..  of  d'  given  h')  on  straightforward  physical  grounds.  For  example  a  bear¬ 
ing  measurement  might  have  a  Gaussian  distribution  with  mean  equal  to  the  true  bearing  of 
the  source  and  variance  dependent  on  the  measuring  device,  signal  strength,  etc. 


+The  only  others  are  the  pretrack  constraints  derived  from  pruning,  report  groupings,  and  the  order  of 
processing.  Depending  on  the  degree  of  generality  desired,  the  structure  of  those  constraints  may  or  may 
not  be  influenced  by  the  application  to  which  we  plan  to  put  the  algorithm. 
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On  the  other  hand,  P(h'lh)  is  not  nearly  so  intuitive,  and  even  after  a  great  deal  of 
thought  its  calculation  generally  requires  some  very  ad-hoc  reasoning.  Recall  that  in 
section  3  we  were  reduced  to  defining  this  quantity  as  the  marginal  distribution  of 
P(h'.d'|h),  which  in  the  present  situation  does  us  no  good  since  P(h’.d'|h)  is  precisely 
what  we  are  trying  to  compute.  A  reasonable  approach  is  to  use  the  relationship 
^P(h’|h)  =  1  as  a  basis  for  determining  these  probabilities;  once  we  have  designated  the 
h' 

probability  of  a  false  alarm,  P(h'  =  h|h),  and  of  a  new  pretrack,  P(h  — — $,  h'lh).  we  need 

0-T 

only  supply  the  "relative"  magnitudes  for  the  probabilities  of  association  with  each  of 
the  existing  pretracks  in  h.  This  is  usually  possible  through  some  heuristic  argument. 

In  the  absence  of  further  structure  the  simplest  solution  is  to  set  these  apriori  (i.e., 
based  on  h  alone  and  not  on  d  )  probabilities  of  association  all  equal  <cf.  15) );  however,  it 
is  easy  to  imagine  situations  in  which  the  information  from  the  past  data  is  more  extensive. 
For  example,  consider  passive  tracking  in  an  ocean  environment.  If  the  data  in  h  are  suffi¬ 
cient  to  estimate  the  targets'  states,  that  is  their  positions,  velocities,  and  source  levels, 
then  one  might  anticipate  that  the  next  measurement  is  more  likely  to  come  from  those 
pretracks  which  will  produce  the  highest  received  signal  levels.  This  information  is  in  addi¬ 
tion  to  the  fact  that,  given  such  an  association,  one  would  expect  it  to  yield  a  more 
accurate  measurement,  i.e.,  a  small  variance  relative  to  the  family  of  random  variables 
D'lh'  distributed  according  to  P(D'lh')  and  parametered  by  h'.  Note  that  in  such  a  case 
decomposition  (24)  has  the  desired  interpretation  only  when  conditional  on  the  generating 
target’s  state  (for  an  explicit  example  see  subsection  4.2  and  equation  ( 27)). 

In  passing,  we  remark  that  many  other  complications  can  enter  the  modeling 
problem.  For  instance,  the  data  may  include  measurements  of  different  types;  e.g..  bear¬ 
ings  and  frequencies.  Inasmuch  as  the  scoring  values  are  fundamentally  heuristic  (see 
next  paragraph),  when  modeling  the  probability  distributions  it  is  just  as  important  to 
gauge  the  relative  effects  of  the  different  measurement  types  on  the  outcome  of  the  data 
association  algorithm  as  it  is  to  give  a  detailed  (but  necessarily  incomplete)  physical  deriva¬ 
tion  for  the  model.  The  choice  of  the  data  measurement  functions  D  can  also  be  relevant. 
For  example,  in  passive  surveillance  just  the  receipt  of  one  type  of  measurement  rather 
than  another  may  be  significant  data  association  information.  Even  the  choice  of  the  false 
alarm  class  depends  on  the  definition  of  clutter;  a  larger  class  may  ease  computation  and 
space  requirements  but  degrade  the  quality  of  the  results. 

Finally,  in  order  to  emphasize  the  ad  hoc  nature  of  the  modeled  probability  dis¬ 
tributions,  for  the  remainder  of  this  section  we  shall  adopt  a  notation  of  the  form  P^d') 
in  place  of  P(d'lh).  The  subscript  indicates  a  parametric  dependence  rather  than  a  condi¬ 
tional  probability  which  is  more  in  keeping  with  an  accurate  physical  interpretation  of 
these  functions.  The  quantities  in  question  are  conditional  probabilities  only  in  a  very 
restricted  sense  (see  appendix  B).  For  example,  P(h'ldj  ...,  djq),  computed  via 
Ph.fl)  (h',d')  -  P(h',d'lh,3))  and  the  recursion  of  equation  (15).  is  in  general  a  function 
of  the  ordering  of  the  data  points  dj;  that  is,  it  is  a  function  of  the  order  in  which  they  are 
input  to  the  algorithm.  This  dependence  on  order  has  nothing  to  do  with  the  temporal 
order  in  which  the  measurements  are  received,  and  it  occurs  even  when  no  pruning  has 
taken  place  during  execution.  It  simply  reflects  the  fact  these  parameterized  distributions 
are  modeled  without  consideration  to  the  joint  distribution  of  the  parameters;  instead,  they 
are  tied  together  by  the  recursion  (15)  which  is  dependent  on  the  input  order.  There  is  no 


reason  to  expect  that  there  exists  some  large,  sample  space  with  a  consistent  physical 
interpretation  (we  can.  however,  construct  an  abstract  space  with  the  desired  properties  - 
see  appendix  B)  for  which  these  (h')  are  conditional  probabilities. 

4. 1  UTILIZATION  OF  TARGET  STATE 

The  modeling  procedure  naturally  divides  itself  into  two  parts,  one  a  description  of 
target  states  and  the  other  of  the  measurement  process.  For  purposes  of  illustration  as  well 
as  simplicity  of  notation,  let  us  momentarily  assume  that  the  measurements  take  the  form 
d  =  (0,t);  i.e.,  target  bearings  at  times  t.  We  also  direct  our  attention  to  the  first  factor  on 
the  right  hand  side  of  equation  (24).  Let  xj*  be  a  fixed  vector  representing  the  true  state 
of  target  j  at  time  t  =  0.  For  example,  it  may  consist  of  four  components  describing  posi¬ 
tion  and  velocity.  Then,  under  additional  model  specifications  such  as  a  linear  track,  signal 
propagation  characteristics,  measurement  device  characteristics,  and  noise  statistics,  we  can 
in  theory  compute  the  probability  distribution  (density  function)  of  the  measured  bearing  6 
of  target  j  at  time  t;  that  is,  P(d|x*).  Suppose  that  h'  is  generated  by  Tj  ^  Tj  u  Jd'} ,  then 
P(d'|x*)  seems  an  excellent  candidate  for  Ph'(d')  except  for  one  major  drawback:  in  general, 

x*  is  unknown. 

J 

There  are  several  approaches  to  solving  this  dilemma.  One  of  them  is  to  assign  a 
probability  measure  to  xjand  compute  P^'td)  via  (cf.  [9] ) 

Ph-(d')=  /  P(0|Xj)dP(Xj)  (25) 

Jxj 

where  dP(xj)  =  dP^(xj)  is  conditioned  on  (parameterized  by)  the  past  data  3).  (Typically, 
it  is  modeled  with  a  dependence  only  on  those  data  points  belonging  to  Tj.)  Note  that  this  is 
essentially  what  occurs  in  the  operation  of  a  Kalman  filter  where  the  apriori  statistics  dP0(xj) 
enter  through  the  initial  value  (i.e.,  when  3)  =  <t>  is  initially  empty)  of  the  state  covariance 
matrix.  One  might  expect  that  with  a  sufficient  amount  of  data  the  dependence  of  the  dis¬ 
tribution  Ph'(d)  on  P0(xj)  would  die  out  (P<p  (xj)  still  remains  a  stochastic  quantity  due  to 
the  joint  distribution  of  the  target  state  and  measurement  process),  and  consequently  many 
presentations  gloss  over  this  aspect.  However,  this  implicit  dependence  should  be  kept  in 
mind  for  logical  consistency  as  well  as  the  fact  that  in  data  association  (a)  new  tracks  are  con¬ 
stantly  being  created  and  (b)  the  effects  of  an  initial  state  may  remain  even  after  the  state 
itself  has  died  out. 

An  alternative  is  just  to  estimate  the  state  xj  using  the  past  data.  For  example,  in 
the  case  of  bearings-only,  any  of  a  number  of  tracking  algorithms  might  be  used  (CHURN, 
MLE,  Kalman,  etc.).  However,  there  is  always  the  possibility  that  the  state  xj  might  not 
be  observable.  In  fact,  for  the  initial  states  of  association  (i.e..  for  pretracks  with  only  a 
few  data  points)  such  a  procedure  is  inadequate. 

More  generally,  in  conjunction  with  the  data  association  framework  described  in 
section  2.  we  advocate  using  whatever  technique  seems  appropriate;  the  choice  should 
depend  on  the  data  found  in  each  pretrack.  For  example,  until  observability  is  achieved, 
one  might  use  the  approach  found  in  subsection  4.2.  Then,  as  more  data  are  acquired  one 
might  want  to  employ  a  standard  tracker  to  make  better  use  of  the  information  available. 

In  other  situations  it  might  be  more  desirable  to  avoid  a  detailed  model  of  a  target  state 
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altogether;  a  metric  for  association  could  be  introduced  directly  on  the  measurements  as  in 
“gating”  (cf.  [7] ,  [9] ).  Note,  however,  that  our  approach  [equation  (1)]  does  require  that 
every  hypothesis  (and  hence  typically  every  pretrack)  has  a  mechanism  for  scoring;  i.e.,  a 
model  for  Ph(h',d').  Also,  for  these  scores  to  be  useful,  they  must  in  some  manner  be 
commensurable.  In  consideration  of  the  large  number  of  assuinptions  and  approximations 
involved,  it  seems  highly  desirable  to  model  Ph(h',d')  in  as  simple  and  straightforward  a 
manner  as  possible  while  maintaining  a  logically  consistent  structure.  One  must  remember 
that  for  the  purposes  of  data  association  the  state  model  is  only  a  tool  (but  a  very  impor¬ 
tant  one)  for  determining  the  relevant  distributions,  and  it  is  the  ability  of  these  distribu¬ 
tions  to  distinguish  the  "true”  hypothesis,  not  necessarily  the  quantitative  precision  of 
those  distributions,  that  will  determine  the  success  of  the  algorithm. 

As  a  final  remark,  we  note  that  a  strong  emphasis  on  target  state  (which  is  both 
natural  and  appropriate  in  situations  such  as  active  radar  (sonar)  surveillance  or  tracking 
a  small  number  of  targets  in  clutter)  can  lead  to  data  association  schemes  quite  different 
from  the  one  presented  here  ([6] ,  [8] ).  Although  almost  all  data  association  algorithms 
deal  with  hypotheses,  measurements,  target  states,  and  their  conditional  probabilities, 
when  assimilating  the  literature  one  must  take  care  not  to  mentally  equate  quantities 
which,  despite  a  superficial  resemblance,  are  often  highly  dependent  on  the  author's 
interpretation. 

4.2  A  NO-FRILLS  MODEL 

In  this  section  we  consider  in  detail  the  construction  of  a  model  for  the  computa¬ 
tion  of  P{j(h',d')  where  the  data  consist  of  passive  sonar  bearing  measurements.  We  begin 
with  D  =  (0,  RL.  t)  where  0  is  a  (possibly  spurious)  bearing  measurement  relative  to  some 
known  position  (i.e.,  that  of  the  measuring  platform),  received  at  time  t  with  received 
signal  level  RL.  Later  we  shall  limit  our  discussion  even  further  by  dropping  the  signal 
level  information  RL  and  replacing  its  role  in  the  model  by  the  assumption  that  a  signal 
can  be  received  only  if  the  source  lies  in  a  convergence  zone  (i.e.,  is  within  certain  desig¬ 
nated  ranges)  with  respect  to  the  measuring  platform. 

Determining  Ph(h',d')  by  a  detailed  analysis  of  the  physical  environment  is  next 
to  impossible;  the  situation  is  too  complex  and  the  necessary  information  is  not  available. 
Influencing  factors  include  target  and  clutter  densities,  propagation  losses,  target  sound 
pressure  levels,  background  noise,  thresholds  and  bandwidths.  and  human  factors  such  as 
the  sonar  operator.  We  therefore  resort  to  ad  hoc  techniques. 

Let  us  start  by  isolating  the  contributions  of  0',  RL'.  and  f  [the  primes  indicate 
new  data,  cf.  equation  (1)] 

Ph(h\0',RL',t')  =  Ph(h',0|RL',t')Ph(t'!RL’)Ph(RL')  (26) 

We  first  examine  Ph(h',0|RL,t)  which  for  convenience  we  write  as  Ph(h',0);  the  latter  two 
factors  will  be  treated  subsequently.  We  shall  base  our  model  on  a  decomposition  similar 
to  equation  (24),  but  conditioned  on  target  location. 
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More  precisely,  let  us  suppose  that  the  prior  hypothesis  h  consists  of  J  pretracks 
Tj  and  that  h’  is  generated  by  the  association  Tj  ■*  Tj  U  J  d'\ ,  i.e.,  that  the  measurement 
0'  had  as  its  source  a  target  corresponding  to  Tj  t  Using  the  notation  xj  to  denote  the 
(possible)  position  of  target  j,  we  may  then  write 


Ph(h\0') 


Ph(0'lh\xj)Ph(h'ixj)Ph(xj) 


(27) 


Note  that  Ph(Xj)  is  the  positional  probability  density  of  target  j  and  h'  is  generated  by 
Tj  -  T" . 

Assume  for  the  moment  that  Tj  also  has  a  known  source  level  associated  with  it 
so  that,  given  that  the  signal  was  emitted  from  target  j  at  position  x,  we  can  use  our 
knowledge  of  the  sensor  location  and  propagation  loss  in  the  medium  to  predict  the 
received  signal  level  at  time  t.  Further,  assume  that  we  have  some  description  of  the 
background  noise  and  the  sensor’s  characteristics  which  yields  the  probability  of  detection 
per  unit  time  as  a  function  of  the  received  signal  level  (commonly  expressed  as  a  ROC  curve, 
the  Receiver  Operating  Characteristic).  This  quantity  can  then  be  expressed  as  a  function  of 
source  position  which  we  designate  0j(x)tt  We  now  make  the  entirely  heuristic  (but  funda¬ 
mental  to  this  particular  model)  premise  that  the  apriori  (that  is,  before  measuring  0') 
probability  of  h'  given  h  is  proportional  to  the  expected  value  of  0;.  Mathematically, 


Ph(hj)  =  ch j(*)aj(x)dxt,+ 

where 

cjj  =  a  constant  (yet  to  be  determined)  dependent  on  h  but  independent  of  j, 

aj(x)dx  =  probability  that  target  j  is  in  a  region  dx  about  x;  thus,  qj(x)  is  the 
density  P^(Xj)  appearing  in  equation  (27),  and 

h!  =  the  hypothesis  generated  by  h  »  h' 

J  Tj  ,T 


where 

T*-TjU|»t 


(28) 


Note  that,  actually,  the  sensor  model  need  only  be  sufficiently  detailed  to  yield  |3j(RL(x)) 
up  to  a  constant  factor. 


^Rigorously,  we  should  write  T:  -»T;  U  j  D’},  but  it  is  more  descriptive  to  use  0’. 
tf 

' '  Note  that  the  (dummy)  variable  x  is  not  the  same  as  found  in  section  3:  it  is  simply  shorthand  for  xj. 
used  for  notational  convenience. 

+  ^+Also  see  the  first  section  of  Appendix  C. 
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Although  we  make  no  pretension  that  (28)  is  quantitatively  precise,  i.e.,  that  it 
represents  a  probability  that  would  actually  be  realized  through  an  ensemble  of  physical 
experiments,  we  do  consider  it  to  be  qualitatively  reasonable.  The  integral  in  (28)  repre¬ 
sents  what  one  might  term  the  relative  likelihood  of  the  next  measurement  being  associated 
with  target  j.  For  example,  suppose  that  we  grossly  simplify  the  situation  and  set^ 

(i)  all  target  source  levels  the  same 

(ii)  propagation  loss  equal  to  a  constant  for  the  direct  path  and  two  CZ's  (con¬ 
vergence  zones)  and  zero  otherwise 

(iii)  aj  a  uniform  density;  i.e.,  aj(x)  =  1/Aj  in  some  specified  region  of  area  Aj  and 
equals  zero  elsewhere 

Then  it  follows  from  (28)  that  Ph(h')  is  proportional  to  5TAjm/Aj,  the  fraction  of  the 

region  containing  target  j  which  intersects  the  detection  region  of  the  measuring  device. 

This  so-called  cookie-cutter  detection  model  is  illustrated  in  Figure  15.  The  proportionality 
factor  Cfo  is  ultimately  to  be  determined  by  equation  (21 );  however,  we  note  that  we  must 
first  not  only  complete  the  models  for  the  other  factors  in  (27),  but  also  consider  the 
possibility  that  h'  is  generated  by  a  false  alarm  (FA)  or  new  target  (NT). 


t(i)  and  (ii)  are  equivalent  to  a  detection  model  in  which  there  is  detection  if  and  only  if  a  target  lies  in 
the  specified  regions. 


Figure  15.  This  diagram  pictures  a  measurement  sensor,  its  direct  path  region  (CZO)  and 
convergence  zones  (CZ1  and  CZ2).  and  regions  corresponding  to  three  targets.  For 
example.  A  ]  is  a  region  associated  with  target  1  and  its  intersection  with  the  CZ's  is  a 
single  region  A]  j  In  general  the  region  in  which  a  target  is  localized  may  not  be  con¬ 
nected  (as  At  for  target  2)  and/or  its  intersection  with  the  CZ's  may  not  be  connected  (as 
in  A30-  A31  for  target  3).  Note  that  Ajm  represents  the  intersection  of  target  j  with  CZm. 


Since  aj(x)  is  the  density  of  xj,  it  follows  from  (28)  (by  taking  the  Radon-Nikodym 
derivative)  that 

ph(hj|Xj)  =  ch/Jj(Xj).  (29) 

Then  equation  (27)  becomes 

Ph(h'.0')  =  ch  Jph(0'|h:,x)^j(x)aj(x)dx  (30) 

where  it  is  understood  that  x  in  Pj1(0' |h!  ,x)  represents  the  location  of  target  j.  In  words, 
equation  (30)  directs  us  to  compute  th^  probability  of  receiving  the  bearing  measurement 
O'  for  target  j  when  it  is  at  x;  weight  this  by  the  probability  of  detection  j3j(x);  multiply  by 
«j(x)dx,  the  probability  that  target  j  is  at  x;  and  integrate  overall  possible  x. 

Computation  of  Ph(0'ihj',x) 

Let  0(x)  be  the  bearing  of  the  position  x  relative  to  the  measuring  device,  and  let 
us  suppose  that  the  measurement  6'  has  a  standard  deviation  a.  (In  general  a  will  be  a 
function  of  the  sonar  system  and  the  received  signal-to-noise  ratio.)  Then  if  we  assume 
O'  has  a  Gaussian-like  distribution,  we  might  model  Pj1(0'|h'.x)  by 


Ph(0'|x)  =  c—  1  e-(0’-^x»2/2ff2 
”  y/2n  ° 

The  constant  c  is  necessary  to  normalize  the  distribution 

0+7T 

J  Ph(0'lx)d0'  =  1 


0-7T 


(31) 


(32) 


since  the  range  of  6'  -  <j>  is  -it  to  tt  rather  than  to  ■*>  (that  is,  it  is  a  truncated  Gaussian 
density).  More  generally,  we  truncate  Ph(0’)  in  a  region  of  width  2aa  <  n  so  that  c  is 
determined  by  the  integral  over  [<p  -  ao,  <t>  +  aa] . 

Considering  the  qualitative  nature  of  our  analysis  to  this  point,  not  to  mention  the 
uncertainty  of  the  Gaussian  assumption,  it  appears  unlikely  to  be  worthwhile  to  exactly 
compute  the  expression  (3 1 )  for  every  x  used  in  the  numerical  evaluation  of  (30).  A  more 
reasonable  procedure  is  to  set  up  a  table  for  a  few  values  of  (6  -  <p)~/a In  fact,  we  may 
go  a  step  further  in  simplification  and  assume  a  uniform  distribution 


Ph(0'|x) 


1  /2a  for  1 6  -  0(x)|  <  a 
0  otherwise 


(33) 


Then  6’  is  uniformly  likely  to  lie  in  wedge  of  2 a  about  the  true  bearing  0(x)  (cf.  Figure  16). 
Of  course  one  may  consider  variations  such  as  replacing  a  by  some  multiple  aa  in  equation 
(33). 


SENSOR 


Figure  16.  Example  of  support  for  bearing  measurement 
probability  density  described  by  equation  (33). 

Note  that  in  view  of  (32),  in  polar  coordinates  P^fl'lh'.x),  as  defined  by  either  (31)  or  (33). 
approaches  the  5-function  8(6'  -  0(x))  when  a  goes  to  zero. 

We  remark  that  an  interesting  study  would  be  to  examine  the  effect  of  various 
distributions  on  the  operation  of  the  data  association  algorithm.  A  few  preliminary  simula¬ 
tions  using  (31)  and  also  (33)  with  a  and  ao  =  2o  seemed  to  indicate  relatively  little  sensi¬ 
tivity.  Of  course,  this  is  entirely  dependent  on  the  environment  simulated. 

Computation  of  0j(x) 

Assuming  we  can  model  the  propagation  loss  as  a  function  of  the  environment  (i.e.. 
the  reduction  in  signal  power  from  a  source  at  x  to  a  receiver  at  the  location  of  the  measure¬ 
ment),  we  can  compute  /3j(x)  provided  we  know  the  source  level  SLj  of  target  j.t  An 
obvious  method  for  determining  SLj  is  to  estimate  it  using  the  past  data.  For  example, 
each  data  point  in  the  pretrack  Tj  includes  a  measured  received  signal  level  RL.  Inverting 
the  propagation  loss  gives  an  estimate  SLj(x)  of  the  source  level  at  x  which  would  have 
given  rise  to  RL.  This  may  be  retained  as  a  function  of  x  or  averaged  over  the  target  den¬ 
sity  (at  the  time  of  the  measurement  RL)  to  give  a  single  estimate  of  source  level.  These 
source  levels,  one  for  each  data  point  in  Tj.  may  then  be  averaged  to  obtain  a  single  source 
level  estimate  for  target  j. 

If  the  above  scheme  takes  too  much  computation,  it  may  be  reduced  by  means  of 
the  following  recursive  approximation.  Assuming  that  0  is  a  monotonic  function  of  RL. 

the  integral  in  (28),  I  =  j 0j(x)aj(x)dx,  which  must  be  computed  anyway,  may  be  used  to 
form  an  estimate  RLj  of  RL'  by  solving  0(RLj)  =  I.  RLj  is  simply  the  predicted  received  ^ 
signal  level  for  6'.  Our  old  source  estimate  then  appears  to  be  in  error  by  a  factor^of  RL'/RLj 
(recall  RL'  is  the  received  level  of  6')  so  that  we  define  SLj  =  XSLj  +  ( 1  -  X)(RL'/RLj)SLj 
where  SLj  is  the  updated  source  estimate  for  the  new  pretrack  Tj'  =  Tj  u  |0'|  and 
X  =  n/(n  +  1)  with  n  =  number  of  data  points  in  Tj.  (Note  that  we  are  simply  using  the 


^The  same  considerations  hold  if  we  are  considering  coherent  propagation,  although  the  situation  is  more 
complex  since  it  includes  signal  phase  and  a  possible  multipath  structure  for  the  acoustic  propagation. 


received  level  as  a  parameter  to  estimate  part  of  the  target  state;  namely,  the  source  level. 

We  are  not  using  it  as  a  random  variable  in  the  same  sense  of  P^RL).  the  last  factor  in 
equation  (2b).) 

As  previously  described,  we  can  simplify  even  further  (although  perhaps  unrealis¬ 
tically)  and  use  the  cookie-cutter  model  of  Figure  15.  In  that  case  0j(x)  is  just  the 
characteristic  function  of  the  shaded  areas  in  the  figure. 

(  1  in  CZ0.CZ1.CZ2 

0j(x)  =  <  (34) 

*0  elsewhere 


which  is  independent  of  j.  Despite  its  shortcomings,  this  model  leads  to  a  surprisingly 
versatile  data  association  algorithm;  at  the  very  least,  it  is  useful  as  a  research  tool  since 
the  simplicity  of  (34)  results  in  a  more  transparent  operation. 


Computation  of  aj(x):  Estimation  of  Target  State 

Let  us  suppose  that  aj(x)  has  been  computed  for  all  pretracks  Tj  during  the  previous 
stage;  to  continue  the  recursion  we  must  compute  aj'(x)  where  Tj'  =  Tj  U  |0'(  as  well  as 
«q(x)  which  we  use  to  denote  the  density  of  the  new  pretrack \d'\ .  Since  aj'(x)  is  just  the 
positional  probability  density  of  the  target  associated  with  Tj'.  we  have^ 


<*j'(x)  =  P(Xj'|hj.0') 

_  P(hj>.  6'.  x) 

POye’) 


(35) 


The  factor  P(hj.0')  is  simply  a  normalizing  constant  which  may  be  removed  by  the  condi¬ 
tion  f  ay(x)dx  =  1 :  i.e.. 


P(hj.fl'.x) 

a.,(X)=- -  (36) 

J  P(hj'.0',x)dx 

When  Tj'  is  not  a  new  target,  aj’(x)  may  be  computed  from  equations  (36)  and  (30)  since 
the  latter  implies 

Ptl(0',hj.x)  =  ch  Ph(0'|x >/3j( x)Qj( x)  (37) 


+  Recall  that  all  our  variables  are  understood  to  be  conditioned  on  the  past  data  so  that  Oj'(x)  really  repre¬ 
sents  cylxIO'.li’)  and  must  be  computed  accordingly.  Actually,  since  track  Tj  can  occur  in  more  than 
one  hypothesis,  our  suppression  of  the  hypothesis  dependence  entails  an  approximation.  In  a  more 
accurate  model,  in  addition  to  the  compulation  of  cy.  Oj(x|h)  must  also  be  updated  to  a  (xlly.0’)  lor 
k  ^  j  in  order  to  reflect  the  "past  data"  which  now  includes  ly  and  O'  (sec  Appendix  C) 


and  Cfo  drops  out  in  the  normalization.  It  is  therefore  a  consequence  of  our  model  that  (36) 
is  only  a  function  of  j'  and  x  (c  f.  (3 1 )  and  (33)),  and  within  that  framework  we  are  justified 
in  the  notation  aj(x).  In  order  to  incorporate  the  case  where  0’  is  from  a  new  target,  we 
postulate  the  existence  of  an  as  yet  unseen  target  lying  somewhere  in  a  very  large  region 
(e.g.,  the  entire  surveillance  area)  with  a  uniform  density.  In  other  words  we  assume  that 
the  aprfbrr  target  positional  density,  aj(x)  for  Tj  =  4>,  is  uniform.  Then  (37)  yields 

Ph(0',NT,x)~Ph(0'|x)0o(x)  (38' 

where,  assuming  source  level  effects  disappear  in  the  normalization,  )3q(x)  may  simply  be 
taken  as  the  propagation  loss  function,  and  P^lfl'ix)  is  given  by  (3 1 )  or  (33). 

Although  aj(x)  may  be  computed  through  (36).  (37)  and  (38),  the  functional 
dependence  on  x  can  be  quite  complex,  and  we  are  led  to  seek  computational  simplifica¬ 
tions.  In  particular,  we  wish  to  mitigate  storage  requirements  for  aj(x)  and  to  make  the 
calculation  of  the  integrals  in  (30)  and  (36)  as  easy  as  possible.  Therefore,  let  us  assume 
that  Ph(0'|x)  has  been  modeled  so  that  its  support  lies  in  a  wedge  of  the  form  pictured  in 
Figure  16,  and  also  that  each  target  Tj  is  concentrated  in  a  finite  number  of  regions  Gjm  of 
area  Ajm  in  each  of  which  aj(x)  is  constant.  Thus 

(ajm/Ajm  x  *n  ^m 

«j(x)  =  <  (39) 

(0  otherwise 

where 

Mj 

£  ajm=  *•  (40 

m=l 

and 

ajm =  J  «j(x>  <41 : 

°jm 

is  the  probability  that  target  j  lies  in  region  Gjm. 

We  first  consider  the  determination  of  the  regions  GQm  foraylx);  i.e..  the  case  of  a 
new  target.  In  general,  AQm  must  be  finite,  so  we  assume  that  there  are  no  detections 
beyond  a  certain  range.  For  simplicity  of  discussion  and  the  sake  of  an  explicit  example, 
we  further  assume  that  detections  only  occur  in  the  three  regions  (direct  path  and  two  con¬ 
vergence  zones)  labeled  CZO,  CZ1 ,  CZ2  in  Figure  15;  that  is,  that  (3j(x)  =  0  outside  these 
regions.  Since  we  have  also  assumed  that  the  support  of  Pj^O'lx)  is  confined  to  a  wedge 
(Figure  16),  it  follows  from  (36)  and  (38)  that  <*q(x)  is  zero  except  in  the  regions  Gq(11 
illustrated  in  Figure  17.  Furthermore,  we  find  from  (41)  that 


Ph(0',x)0o(x)dx 


(421 


The  symbol  denotes  “is  proportional  to.” 
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Figure  1 7.  Example  of  regions  Ggm  representing  the  support  of  the  probability 
density  «q(x)  for  a  new  target.  The  angle  subtended  at  the  sensor  is  typically 
some  multiple  of  the  measurement  variance  a  and  is  centered  about  the 
measured  bearing  O'.  (This  differs  from  Figure  16  which  is  centered  about  0.) 


We  next  consider  the  construction  of  Gj'g '  corresponding  to  aj'(x)  where 
Tj’  =  Tj  u  j 0'}  arises  from  the  association  of  9'  with  a  previously  existing  pretrack  Tj.  Let 
the  support  of  the  pretrack  density  aj(x)  be  given  by  a  union  of  regions  Gjg.  namely, 

u  Gjg.  (There  is  no  problem  with  a  recursive  construction  since  at  the  first  stage  of  the 
6=1 

algorithm  there  are  no  pretracks  (except  <j> )  and  hence  6'  can  only  produce  a  new  target 
pretrack,  and  that  is  handled  by  (42).)  Then  by  (37)  and  the  previous  assumptions,  which 
imply  that  the  support  of  P^(0' lx)(3j(x)  is  as  pictured  in  Figure  17.  the  new  pretrack  must 
lie  somewhere  in  u  Gj^  n  Gq,,,.’ 


+We  have  glibly  glossed  over  the  dependence  of  Gjt  on  time.  In  the  current  subsection  all  regions  arc 
assumed  to  be  valid  at  the  time  of  the  measurement  O'  Thus,  if  the  pretrack  T-  was  computed  at  time 
t  but  O'  was  measured  at  time  t'.  we  must  find  some  means,  based  on  the  target  s  motion,  of  propagating 
the  regions  Gjj  and  the  densities  Ojlx)  from  t  to  t'.  Sec  the  subsection  tilled  ”a(x.t):  Propagation  of 
Target  Position  Density  with  Time." 
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(43) 


The  natural  choice  for  Gyg'  is  then  clearly 


n  G 


Om 


where  £'  =  (£-  l)Mg  +  m;  m  =  1 . Mq;  and  £  =  1 . L  (cf.  Figure  1 8).  Of  course  the 

number  of  regions  L'  =  LMq  increases  rapidly  with  each  stage  (i.e.,  measurement)  of  the 
algorithm.  To  overcome  this  difficulty,  after  computing  the  ajY  we  order  the  regions 
Gjy  according  to  decreasing  probability,  delete  all  regions  with  8'  greater  than  some  pre¬ 
determined  bound  Lq,  and  then  renormalize  by  (41).  The  current  software  has  Lq  set 
equal  to  three. 

Finally,  let  us  determine  expressions  for  ayg"  From  (41)  and  (37) 

aj'8'  ~  /  Ph(0’|x)/3j(x)aj(x)dx  (44) 

-'GjY 


The  substitution  of  (39)  yields 


aj'8' 


Jc  J  G 


P(0;!x)/3j(x)dx 


'j£m 


(45 


where  Gjgrn  -  Gyg-  =  Gjg  n  GQm.  All  quantities  on  the  right  side  of  (45)  are  known  (assum 
ing  we  can  compute  ajg,  Ajg  and  Gjgm  as  a  function  of  time  as  will  be  described  in  the  sub¬ 
section  on  “Propagation  of  Target  Position  Density”). 


SENSOR 


Figure  1 8.  Illustration  of  regions  Gj'gm  =  O  Gq())  formed  by  regions  containing  a 
previous  target  Gjg  and  those  determined  by  the  measurement  9  •  G0m- 


Note  that  if  we  approximate  P^tf'ihj.x)  by  a  distribution  which  is  zero  outside  ot 

GQm  as  in  Figure  17,  then  the  integral  in  (30)  may  be  computed  as  the  sum  over  6'  (i.e.. 

over  8  and  m)  of  the  integrals  in  (44)  thus  saving  computation  time.  This  relationship  is 

more  than  accidental.  In  fact,  the  quantity^apn.^  is  the  probability  that  6'  is  associated 

m  J 

with  a  target  in  Gg,  given  that  it  is  associated  with  the  pretrack  Tj  We  could  even  imagine 
a  structure  in  which  each  region  Gg  belonging  to  pretrack  Tj  is  represented  as  a  distinct 
pretrack;  i.e.,  pretracks  as  sets  of  data  points  union  regions.  However,  such  a  procedure 
would  incur  increased  storage  and  maintenance  requirements. 

In  special  situations  other  simplifications  can  be  made.  For  example,  if  P(0'|x)  is 
a  “constant”  as  in  (33).  then  (45)  becomes 


aj'8 


|3j(x)dx 


(46) 


Furthermore,  under  the  cookie-cutter  approximation  (cf.  equation  (34))  expression  (46) 
simplifies  to 

aj'e'  ~  Ajeni  (47; 

This  may  be  interpreted  to  mean  that  the  probability  aj-g-  that  the  target  Tj  is  in  the 
region  Gjgm  is  proportional  to  the  probability  that  pretrack  Tj  is  in  region  Gg  times  the 
ratio  of  the  area  of  G-g-  to  that  of  Gg.  In  other  words,  the  probability  that  Tj'  is  in  Gjgm 
given  that  it  is  in  Gg  is  proportional  to  the  ratio  of  their  areas.  The  proportionality  constant 
depends  on  j'  and  is  independent  of  £  and  m.  We  may  also  write  (46)  as 


which,  loosely  speaking,  is  the  geometric  probability  that  Tj  is  in  Gjgm  times  the  average 
probability  of  detecting  Tj  if  it  is  in  Gjgm . 

Computation  of  cj,.  Probabilities  of  New  Target  and  False  Alarm 

The  constant  c^  in  equation  (30)  is  determined  by  the  condition  [cf.  equation  (21)1 
that  P^(hj,0')  be  a  probability  density 

/  £  Ph(h',0')=l.  (48 

-V  }h'ih-»h'[ 


When  h'  is  generated  from  a  previously  existing  pretrack  Tj  e  h.  we  can  calculate  the  cor¬ 
responding  term  of  (48)  from  (30)  by 


since  the  integral  over#'  yields  1.  (Cf.  (32)  and  (33).  P^ffl'ihj.x)  must  be  a  probability 
density  in  i.e.,  integrate  to  1 .)  This  leads  us  to  definet 


yj- j  Pj(.x)atj(x)dx  (50) 

which  corresponds  precisely  to  the  quantity  7(T,T")  of  section  2.5  with  T  =  Tj  and 
T"  =  Tj  U  \d'\ .  If  we  let  P^fNT,#')  and  P^fFA,#')  be  the  probabilities  corresponding  to 
the  cases  for  which  6'  belongs  to  a  new  target  and  O'  is  a  false  alarm,  respectively,  then 
(48)  becomes 

ch^fj+  j  Ph(NT,«')+  j  Ph(FA,fl')=l  (51) 

j  -V 

We  have  yet  to  determine  P^(NT,#')  and  P^(FA,0').  Since  in  both  cases  the 
probability  with  respect  to  d'  is  uniform  (assuming  an  isotropic  environment),  we  can  set 

Ph(NT.8')*ji:Yh(NT) 

(52) 

Ph(F A.#')  =  7h(FA) 

where 


7h(NT)  +  7h(FA)  +  ChiC7)  =  1  (53) 

j 

The  parameters  7^(NT)  and  7i1(FA)  appear  even  more  difficult  to  model  than  the 
previously  treated  quantities.  We  could  set  "y(NT)  equal  to  ^j17j1(NT)  where  7j1(NT)  is  deter¬ 
mined  analogously  to  the  7 j;  namely.  7^(NT)  =  [ 0(x)ayl(x)dx  where  all  new  targets  are 
assigned  the  same  nominal  source  level,  and 

l  (NTOT-J)/(surveil!ance  area)  for  J  <  NTOT 
c*h(x)  =  <  (54) 

I  0  for  J  >  NTOT 


+Note  that  the  integral  in  (50)  is  over  the  entire  space.  For  the  cookie-cutter  model  its  support  (i.e..  the 
region  where  the  integrand  is  non-zero)  lies  in  the  intersection  of  the  CZ‘s  (support  of  (3j)  and  the  regions 
Gjg.  This  corresponds  to  Figure  1 5,  not  to  the  Gjj  n  Gq|T)  of  Gjg.  This  is  because  7  is  proportional  to  the 
apriori  probability  of  hj  (the  marginal  distribution)  and  hence  is  independent  of  0  (i.e..  of  the  wedge  in 
Figure  17).  A  consequence  is  increased  computation  since  (44)  will  not  suffice  to  compute  (50)  as  it  did 
for  (30). 
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Here  NTOT  is  the  expected  total  number  of  targets  in  the  surveillance  area  and  J  is  the 
number  of  pretracks  (i.e..  targets)  in  the  hypothesis  h.  Note  that  / ah(x)  =  NTOT-J  is  not 
in  general  equal  to  1  so  that  aj,(x)  is  a  target  density,  not  a  probability  density.  We  are 
still  left  with  the  problem  of  determining  a  source  level  (although  for  the  cookie-cutter 
case  this  is  provided  by  (34)  and  NTOT). 

In  the  case  of  false  alarms,  one  is  more  inclined  to  pick  a  rate  Xp  so  that  -yj^FA)  is 
proportional  to  Ap(At)  where  At  is  the  time  since  the  previous  data  measurement.  Even 
then  one  must  take  care  that  Xp  is  determined  relative  to  some  “steady  state”  in  which  an 
average  number  of  targets  is  present.  Certainly,  for  most  sensors  (sonar  systems),  if  the 
noise  level  is  constant,  the  false  alarm  rate  will  go  down  as  the  number  of  targets  present 
goes  up. 

In  Appendix  C.  these  concepts  are  combined  to  produce  a  model  for  both  ^(NT) 
and  ^(FA)  which  depends  on  NTOT.  J.  and  the  ratio  of  a  false  alarm  rate  to  a  target  detec¬ 
tion  rate  and  is  independent  of  At.  However,  our  current  feeling  is  that  these  quantities 
should  be  viewed  as  tuning  parameters  which  adjust  the  algorithm’s  proclivity  to  accept 
data  and  form  associations,  and  that  care  should  be  taken  not  to  become  locked  into  too 
physical  an  interpretation.  The  algorithm's  sensitivity  to  the  choice  of  the  above  parameters, 
possible  choices  for  functional  dependence  on  J,  and  a  more  rational  discussion  (we  have 
clearly  been  nandwaving)  remain  subjects  for  future  study. 

a(x,t):  Propagation  of  Target  Position  Density  with  Time 

Although  we  have  ignored  the  dynamics  of  target  motion  up  to  this  point,  it  is  clear 
that  the  target  positional  density  aj(x)  is  actually  a  function  of  time;  i.e.,  aj(x.t).  This  time 
dependence  is  critical  inasmuch  as  in  the  previous  equations  (cf.  (30)  and  (44),  for  example) 
the  quantities  P^fl'ih'.x)  and  aj(x)  (equivalently  ajg,  Ajg  and  Gjf)  are  assumed  to  be  evalu¬ 
ated  relative  to  the  same  physical  time.  However.  6'  is  measured  at  t’  the  time  of  the  latest 
detection  whereas  ajg  and  the  region  Gjg  were  computed  at  t  (the  time  of  the  previous 
measurement)  using  (42)  and  (44). 

More  precisely.  (45)  should  be  written 
,  aj8*1  *  / 

aj'gdt  )  =  A  (-py  /  P(0  |hj.x.t’)/3j(x)dx  .  (55) 

Since  a^lt).  Aj^(t),  and  Gjg(t)  were  determined  at  the  previous  stage  of  the  algorithm,  to 
complete  the  recursion  we  must  find  a  means  of  deriving  ajg(t’).  Ajj(t').  and  GjCm(t')+ 
from  these  quantities.  Also,  equations  (30).  (37).  and  (42H50)  must  be  computed  at 
time  t'. 

Our  results  shall  be  restricted  to  densities  of  the  form  (45).  Suppose  that  a  target 
is  in  a  region  GjC( t )  at  time  t.  If  its  dynamics  were  exactly  known,  then  the  region  Gjg(t') 
which  the  target  would  be  (would  have  been)  in  at  time  t'  could  be  computed  as  a  simple 


*Note  that  Gjgm(t)  =  Cijg( t )  n  G»Q,n( * )  *s  easily  found  but  does  not  equal  Gjgn)(t’)  for  l  ^ 


translation  of  Gj£(t)  (see  Figure  19a).  More  generally,  even  if  the  velocity  of  the  target  j 
as  a  function  of  t  is  unknown,  we  expect  Gj£(t)  to  “propagate”  into  some  region  Gj£(t'). 
The  probability  at  time  t'  that  the  target  lies  in  Gj£(t')  is  the  same  as  that  at  time  t  of  the 
target  lying  in  Gj£(t).  In  other  words,  aj£(t')  =  aj£(t).t  However,  although  the  new  area 
Aj£(t')  may  be  computed  directly  from  Gj£(t'),  the  density  <*j£(t')  need  no  longer  be  uni¬ 
form.  In  fact,  depending  on  our  knowledge  of  the  velocity,  its  computation  can  be  quite 
involved  [  12] . 

One  case,  perfect  knowledge  of  v,  has  already  been  mentioned  and  its  density  is 
simply  a  translation  a(x,t')  =  a(x  -  v(t'-t),  t).  At  the  other  extreme,  let  us  consider  the 
case  of  no  knowledge  of  the  velocity  of  the  target,  simply  a  maximum  speed  s^.  Then 
at  time  t'  the  target  will  lie  (could  have  lain)  at  any  point  within  a  distance  s^i  t-t'|  of  the 
region  Gj£(t).  This  propagation  of  a  region  is  illustrated  in  Figure  1 9.  The  corresponding 
densities,  assuming  the  velocity  direction  and  magnitude  are  uniformly  distributed,  are 
related  by 


Figure  19.  (a)  Example  of  propagation  of  regions  when  velocity  is  known  exactly. 

Note  that  such  propagation  may  be  done  backward  and  forward  in  time  with 
impunity,  (b)  Example  of  propagation  when  only  an  upper  bound  on  the  speed. 

Sj^j,  is  known  and  the  velocity  is  uniformly  distributed  in  direction  and 
magnitude. 

^This  equation  holds  in  between  the  input  of  data  points;  i.e.,  during  the  algorithm  stage  identified  by  jt 
as  opposed  to  j'£'  in  equation  (55).  There  is  no  restriction  on  t'  -  it  can  be  before  or  after  t.  The  reader 
should  be  careful  not  to  confuse  the  time  ordering  of  the  algorithm  with  the  measurement  times.  They 
need  not  be  related. 


We  note  that  the  density  is  a  maximum  at  the  “center”  and  decreases  to  zero 
at  the  perimeter.  (A  similar  result  is  obtained  in  [12]  if  we  replace  Koopman’s  condi¬ 
tion  |v|  =  constant  by  |v|  <  s^j.  This  contrasts  with  the  annulus-shaped  distribution  which 
is  obtained  when  the  speed  is  assumed  known  and  the  course  is  random.)  If  we  wish  to 
retain  the  simple  model  of  densities  which  are  constant  over  the  regions  Gjg.t  we  must 
approximate  a(x,t')  by  a  constant  density;  namely,  the  reciprocal  of  the  area  of  Gjgft'). 

It  might  be  reasonable  to  first  shrink  the  region  Gjg(t')  from  that  pictured  in  Figure  19 
since  the  actual  density  [equation  (56)]  is  small  near  the  perimeter. 

Once  again,  at  this  point  it  is  not  clear  what  effects  such  an  approximation  has  on 
the  data  association  algorithm.  Almost  certainly  a  variable  density  would  involve  consid¬ 
erably  more  storage  and  computation.  However,  it  is  possible  that,  depending  on  the  data 
present  in  the  pretrack  Tj,  varying  degrees  of  information  regarding  the  target  velocity 
may  be  surmised.  At  the  time  of  this  report  only  a  very  simple  model,  |v|  <  sj^,  has  been 
implemented,  but  it  has  proved  capable  of  performing  at  least  rudimentary  data  association 
(see  subsection  titled  “Summary"). 

Ph(t,RL)  and  Ph(RL) 

It  is  clear  that  (in  the  passive  sonar  case)  the  probability  of  receiving  a  measurement 
varies  with  the  interval  of  observation,  so  that  in  general  we  may  expect  the  time  interval 
t'  -  t  to  have  a  direct  influence  on  P^fh'.d)  =  Pj^h'.G'.t'.RL')  in  addition  to  its  role  in  the 
propagation  of  target  states.  For  example,  the  number  of  detections  (possibly  false)  per 
unit  time  may  depend  on  the  number  of  targets  present,  and  hence  the  factor  P^ft'IRL') 
in  equation  (26)  will  be  a  function  of  h.^f  However,  the  treatment  in  Appendix  C  seems 
to  indicate  that  these  are  secondary  effects  likely  to  be  eclipsed  by  our  incomplete  knowl¬ 
edge  of  environmental  parameters.  Thus,  for  the  present,  it  appears  advisable  to  regard 
that  term  as  approximately  independent  of  h  (at  any  given  stage  of  the  algorithm)  and  to 
absorb  it  into  the  normalization. 

On  the  other  hand,  P^fRL')  may  be  useful.  It  should  be  some  reflection  of  the 
“distance”  between  the  measured  signal  level  RL(t')  and  that  predicted  by  the  past  data 
through  j3j(x),  which  is  clearly  a  function  of  h.  Many  straightforward  models  may  be 
imagined;  we  shall  not  go  into  any  detail.  Note  that  if  the  source  level  is  not  modeled 
as  in  the  case  of  equation  (34).  this  term  is  not  relevant  and  should  be  omitted  from  (26). 


+  Otherwise.  we  must  use  (36).  a(-(x)  ~  P{0'\x)aAxmx).  in  place  of  (45). 

+  f  '  J 

Note  that  (26)  is  an  asynchronous  scheme  in  which  the  time  of  measurement  contains  the  information. 

An  alternative  point  of  view  is  that  of  [3|  which  divides  time  into  discrete  intervals  and  computes  for 

each  interval.  Not  receiving  a  measurement  is,  of  course,  information,  but  to  make  use  of  it  our  recursive 

scheme  would  require  an  update  foi  every  time  interval. 
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Summary  of  Equations 

The  quantities  P(T"  |T)  and  7(T"  ,T)  were  introduced  and  briefly  discussed  in  section 
2.5  on  scoring.  The  present  section  has  been  devoted  to  a  detailed  derivation  of  the  equa¬ 
tions  for  their  computation.  The  resulting  correspondence  with  our  “no-frills”  model  is 
given  by  P(T"|T)  <*  P(hj,0')  and  7(T",T)  »  7j  where  T"  =  Tj'.  T  =  Tj.  and 


!chP(hj .0 )  for  Ty  =  Tj  U  \Q'\ 
7h(NT)  for  Tj>  =  j  0' } 
Th(FA)  for  Tj<  =  |0’,F{ 


Comparing  (57)  with  (30),  we  see  that  ?(hj,0')  is  indeed  a  function  only  of  T  and  T" .  (The 
same  is  of  course  also  true  for  7j;  cf.  equation  (50).)  The  remaining  cases,  i.amely  when  T" 
is  a  new  target  pretrack  or  false  alarm,  differ  from  their  counterparts  in  section  2.5  inas¬ 
much  as  they  are  incorporated  directly  without  requiring  normalization  by  c^  (see  equation 
(50)).  However,  since  they  are  hypothesis  dependent,  their  contribution,  ( 1  /27r)7j1,  is  com¬ 
puted  at  the  start  of  the  second  large  block  in  Figure  14  rather  than  during  pretrack 
generation. 

The  determination  of  the  functions  in  (57)  has  required  the  computation  of  inter¬ 
mediate  quantities  related  to  target  state.  We  summarize  the  pertinent  equations  below. 

A  flow  diagram  appears  in  Figure  20. 

Forj'^0. 


Ph(h],0')  =  ch  Jph(0'|x)0j(x)aj(x,t')dx 

7j  =J  0j(x)o<j(x,t')dx 


«j-(x)  ~  Ph(0'|x)j3j(x)aj(x,t') 


and  for  j'  =  0 


a0U)~Ph<e'|x)/30(x)  <6 

The  new  source  level  of  target  Tj'  may  be  approximated  as  in  the  subsection  on  the  "com¬ 
putation  of  0j(x)”  by  using 


SLj'  =  XSLj  +  ( 1  -X)(RL'/RLj)SLj 


where  0j(RLj)  =  7j,  and  X  is  related  to  the  number  of  data  points  in  Tj. 
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6'  generates 
new  target 


6'  associates 
with  Tj  at  i! 


Determine  new 
state  for  T, 


compute  yj>,  Ihj.e') 


FOR  fi,m  =  1  to  3  DO: 
Gj'em  =  GiC(t',nGOm(''> 


compute  8j»£,  s^< 


PICK  3  regions  G-»g<  of  the  highest  aj'gm 


normalize  to  get  a^g, 


Figure  20.  Flow  diagram  for  scoring  details  of  no-frills  model. 


Note  that  aj«(x)  and  oq(x)  are  determined  by  (60),  (61),  and 


*(x)  =  1 


while  cjj  follows  from 


7h(NT)  +  7h(FA)  +  ch  ^  7j-  =  1 


where  ^(NT)  and  ^(FA)  are  tuning  parameters  or  determined  as  in  Appendix  C. 


When  Pj^tf'lx)  and  qj(x)  are  approximated  in  terms  of  a  finite  set  of  characteristic 
functions  of  bounded  support  as  in  Figure  18,  these  equations  reduce  to: 

For  j'  ^  0 

Ph(hj,fl')  =  eh  .~k  /  Pu(0'|x)j3j(x)dx  (65) 

J  fi.m  >  JGj8m(f) 


(66) 


(67) 


(68) 


(69) 


Note  that  Gjg  =£  u  Gjgm  so  that  even  when  P^fO'ix)  is  uniform  the  integral  in  (66)  cannot 
be  expressed  in  terms  of  those  computed  in  (65). 

A  Simulation 


As  a  preliminary  test  of  this  model  several  very  simple  scenarios  (with  no  noise) 
were  examined.  Two  examples  are  found  in  Figures  21  and  22,  respectively.  In  both  figures 
two  stationary  measurement  platforms  are  present  receiving  bearing  measurements  from  two 
targets  moving  at  a  speed  of  5  knots.  These  measurements  were  obtained  by  both  platforms 
at  time  intervals  of  about  2  minutes  from  all  targets  within  a  detection  region  (i.e.,  con¬ 
vergence  zone)  of  the  platform.  In  Figure  21  the  period  of  observation  was  22  minutes:  in 
Figure  22.  it  was  10  minutes. 

The  first  case  (Figure  21 )  was  chosen  particularly  to  exhibit  the  ability  of  the 
algorithm  to  associate  data  received  at  two  platforms  as  coming  from  a  single  target  A.  In 
contrast,  that  of  Figure  21  demonstrates  that  it  also  can  separate  the  data  from  two  targets 
which  are  close  together  (C  and  D).  It  was  found  in  these  and  other  runs  that  the  ability 
of  BAYR  to  perform  the  correct  associations  varied  with  the  system  parameters  among 
which  we  include:  the  apriori  measurement  variance  a:  the  upper  bound  for  target  speed, 
s^j;  and  the  number  of  convergence  zones  under  consideration. 
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KYD  KYD 

(a)  (b) 

Figure  21 .  (a)  The  tracks  of  two  targets  A  and  B  with  two  stationary  measurement  platforms 
PI  and  P2.  The  target  A  lies  in  the  first  CZof  Pi  and  of  P2;  that  of  B  lies  in 
the  direct  path  region  of  PI  and  is  not  detectable  by  P2. 

(b)  Results  of  the  data  association  algorithm  BAYR.  The  most  probable 
hypothesis  contains  two  pretracks  T25  and  Tj5  corresponding  to  the 
targets  A  and  B.  The  localization  regions  for  these  pretracks  are  also 
illustrated. 


-10.0  10.0  30.0  50.0  70.0  90.0 

KYD 
(a) 


-10.0  -6.0  -2.0  2.0  60 
KYD 
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Figure  22.  (a)  Same  scenario  as  Figure  21  with  different  targets.  The  tracks  of  C  and  D 
both  lie  within  the  first  CZ  of  PI  and  of  P2. 

(b)  Results  of  the  data  association  algorithm  (highest  probability  hypothesis). 
Note  the  scale  and  extent  of  the  axes  differ  from  Figure  22a. 
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The  maximum  speed  sj^  was  set  at  25  knots  in  Figure  21  and  at  10  knots  in  Fig¬ 
ure  22.  Note  that,  in  Figure  21,  the  target  B  is  not  so  easily  localized  as  target  A  since 
there  is  no  bearing  crossfix  (B  cannot  be  detected  from  platform  P2).  However,  the 
algorithm  was  still  capable  of  eliminating  the  second  CZ  region  from  the  pretrack  T  j 
This  was  because  the  observed  bearing  rate  would  have  implied  a  speed  larger  than  s^ 
for  such  a  target,  In  a  separate  run  of  the  scenario  of  Figure  21a  (in  which  sj^  was  changed 
to  10  knots,  a  value  closer  to  the  target  speed),  the  first  CZ  region  for  B  disappeared  as 
well,  leaving  only  the  direct  path  quadrilateral. +  The  results  for  this  case  were  not  sensi¬ 
tive  to  a  (a  =  1.0  degree  in  Figure  21b). 

In  contrast,  in  order  to  resolve  the  two  targets  in  the  scenario  of  Figure  22a,  it  was 
necessary  to  set  a  =  0. 1  degree.  This  is  the  value  used  in  Figure  22b.  As  mentioned,  the 
run  pictured  in  Figure  22b  has  s^j  set  to  10  knots.  In  a  separate  run  of  the  same  geometry, 
but  with  sj^  =  25  knots,  the  targets  were  not  quite  so  well  resolved.  This  behavior  is  a 
result  of  the  loss  in  localization  accuracy  during  the  period  between  measurements;  that 
is,  the  propagated  region  G(t')  is  relatively  larger  for  larger  sj^  (see  Figure  19). 

The  preliminary  nature  of  these  results  cannot  be  overstressed.  The  model  devel¬ 
oped  in  this  section  is  in  no  sense  optimal,  nor  has  it  been  adequately  evaluated.  It  should 
be  considered  more  of  an  illustration  of  modeling  techniques  and  an  indicator  of  the  poten¬ 
tial  of  the  Bayesian  data  association  framework  established  in  this  report. 


^The  regions  pictured  are  quadrilaterals  because  that  is  how  the  software  approximates  the  regions 
Gjg  defined  in  the  past  subsections. 


APPENDIX  A:  STRUCTURAL  ASPECTS  OF  THE  DATA  BASE 


GRAPH  THEOREMS 


Theorem  Let  Tj  and  Tj  be  nodes  of  a  graph  generated  by  the  algorithm  of  Figure  3 
Then  there  is  at  most  one  path  from  Tj  to  Tj. 


Pf  Let  the  links  of  the  graph  be  interpreted  as  juxtaposition.  For  example,  if 
Tj  =  |dj  ,dij ,  T->  =  j  d^.djl  and 


ri  • 


then,  T3  =  |  d  i ,  d2,  d2-  d3  | .  The  track  generation  algorithm  implies  that  the  parents  of  a 
node  are  always  disjoint  (for  instance,  the  above  example  would  never  occur).  Pruning 
does  not  destroy  this  property.  Thus,  when  restricted  to  the  pretrack  graph,  juxtaposition 
is  the  same  as  a  union.  Suppose  there  existed  two  paths  from  Tj  to  Tj 


Then  since  we  are  justified  in  interpreting  the  edges  as  juxtaposition,  the  data  points  of 
Tj  would  appear  in  Tj  twice.  But  this  does  not  happen  (it  contradicts  the  union  interpre¬ 
tation);  hence  there  cannot  be  two  paths. 

Corollary  A  node  and  its  descendents  constitute  a  tree 

By  the  above  theorem  and  connectedness,  it  follows  that  there  is  a  unique  path 
between  any  two  nodes  of  this  subgraph.  Therefore,  it  is  a  tree  [  10] . 

SETS,  TABLES,  AND  ACCESS 

We  may  specify  a  hypothesis  in  either  of  two  ways: 

(a)  We  can  list  all  pretracks  in  the  hypothesis,  or 

(b)  for  each  pretrack  we  can  list  the  set  of  hypothesis  to  which  it  belongs. 

One  straightforward  manner  in  which  to  implement  these  relationships  is  through  a  table 
(i.e.,  a  two-dimensional  array).  For  example,  if  we  identify  hypotheses  by  the  integers  I 
to  7  and  pretracks  by  the  letters  A  to  D.  we  obtain  a  table  of  the  form 


D 

2 

3 

| 

5 

6 

D 

ID 

0 

1 

0 

1 

0 

n 

B 

D 

a 

0 

0 

0 

0 

0 

C 

0 

0 

a 

0 

0 

0 

0 

D 

0 

0 

i 

_ 

0 

n 

■ 

Table  A-l 


A  one  (zero)  appears  in  a  box  if  and  only  if  the  pretrack  of  the  corresponding  row  is  (is  not) 
a  member  of  the  hypothesis  of  the  corresponding  column. 

Another  possibility  is  to  use  sets  of  the  form ' 

£T*(i)  =  jZ|  pretrack  Z  €  hypothesis  if 
which  follow  description  (a);  or  we  could  use  the  sets 
J(*( Z)  =  |i|  pretrack  Z  e  hypothesis  i| 

which  follow  description  (b).  In  fact,  these  sets  are  just  alternative  representations  of 
Table  A-l  as  a  vector  (i.e..  one-dimensional  array)  of  sets.  The  sets.4(*(Z)  are  the  rows  of 
Table  A-l  indexed  by  the  columns.  For  example,  J(*(D)  =  J3.4.6.7} .  The  sets  of  2T*(i) 
are  the  columns  indexed  by  the  rows;  e  g..  U  (3)  =  j  A.C.Df . 

There  is  very  little  advantage  to  keeping  both  representations.*^  For  example,  per¬ 
forming  some  operation  f(Z)  on  all  the  pretracks  of  iQ  requires  the  same  amount  of  compu¬ 
tation  in  case  (a)  as  in  case  (b).  For  (a),  the  code  takes  the  form 

For  Z  =  A  to  D  DO 

If  Z  e  £T*(i0)  then  f(Z). 

In  the  case  (b).  we  have 

For  Z  =  A  to  D  DO 

If  ioe.fl*(Z)  then  f(Z). 

Even  though  £r*(i0)  is  exactly  the  set  we  are  seeking,  we  still  have  to  perform  a  loop  in 
order  to  access  its  contents.  Only  if  f  were  a  set  operation  rather  than  an  element  opera¬ 
tion  would  we  expect  one  representation  to  have  an  advantage  over  the  other. 

Such  a  situation  does  occur  in  pruning  operations.  Since  all  the  pruning  operations 
examined  in  section  2.4  are  functions  of  the  operation  remove*(h),  we  examine  remove*(h) 
under  the  two  representations  (a)  and  (b).  Let  Tmax  and  Hn1ax  represent  the  number  of 
pretracks  and  hypotheses,  respectively.  Then  remove*  takes  the  form 


*Z  is  a  variable  with  possible  values  A,  B.  C.  or  D.  while  i  is  a  variable  with  values  1  to  7. 

+*Note  that  even  if  it  is  the  case  that  adding  structure  to  the  data  base  produces  a  more  rapid  search,  the 
advantages  may  be  overridden  by  the  cost  of  updating  the  additional  structures. 
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(i)  For  h'  #  h  form  .T  =  ^  ,u  £7*(h’),  which  requires  a  loop  over  Hmax  hypotheses 

(ii)  For  all  T.  if  T  remove  T  which  requires  a  loop  over  T|n  x  pretracks. 

Case  (b) 

For  all  T  remove  h  from  ,4(*(T).  and  if  .W*(T)  is  now  <p.  remove  T.  This  requires 

one  loop  over  Tmax  pretracks. 

We  see  that  case  (a)  requires  a  search  over  Hnlax  +  Tmax  elements  whereas  case  (b) 
only  needs  our  examination  of  Tmax  elements.  Based  on  this  we  have  chosen  structure  (b); 
i.e..  JK*.  (Of  course,  it  is  understood  that  this  is  by  no  means  the  optimal  structure  for  all 
the  pruning  operations  discussed  in  section  2  since  expressing  them  in  terms  of  remove *(h) 
does  not  necessarily  lead  to  the  most  efficient  algorithm.)  The  PASCAL  code  for  our  data 
structure  appears  in  Figure  A-l ;  that  for  the  procedure  HGF.N  is  found  in  Figure  A-2. 

For  completeness,  we  mention  one  other  possibility,  that  of  replacing  the  above  sets 
by  linked  lists.  This  would  certainly  improve  access  speed  since  one  would  only  have  to 
proceed  down  a  list  of  members  rather  than  test  all  possible  candidates  for  membership 
in  a  set.  On  the  other  hand  (at  least  when  programming  in  a  high  level  language),  a  member 
and  its  link  would  require  two  words  of  storage  as  opposed  to  a  single  bit  in  a  set.  Further¬ 
more,  either  the  space  reserved  for  each  list  must  be  the  maximum  anticipated,  or  a  garbage 
collection  procedure  must  be  introduced.  Finally,  if  one  utilizes  lists,  then  in  programming 
procedures  such  as  HGEN  which  modify  the  lists  themselves,  one  must  be  extremely  careful 
to  avoid  logical  errors.  For  these  reasons,  we  have  chosen  to  use  sets,  not  lists,  in  imple¬ 
menting  the  pretrack-to-hypothesis  relationship. 


CONST 

trkmax  «  T23:  “  '  * 

hypmax  *  128; 

TYPE  '  " 

{ARCHITECTURE  OF  HYPOTHESIS  UNIVERSE . } 

hyp_ind  =  1.. hypmax; 
hyp_ptr  =~  ’hypothes I s;  " 

hypothesis  - 

~  RECORD  .  ”  -  ~  - 

id:  hy p_ i nd : 
fptr:  hyp_ptr; 

END;  ~~  — — 


{ENO  ARCHITECTURE  OF  HYPOTHESIS  UNIVERSE . } 

(ARCHITECTURE  OF  TRACK  UNIVERSE:  ■  ITTVrT TT.  . T 7TT7T.~TTVT - 


trk_ind  -  1. .trkmax; 

t  rk_pt  r  ^  track  ; 
trk1nk_ptr  =  *trklnk; 

trklnk  =  ~  ' _ . 

RECORD 

t  rk :  t  rk_p  t  r ; 

f ptr :  trk i nk_pt r  . 

END; 

hyp_set  -  SET  OF  hyp_ind;  . 

track  * 

RECORD  “ . 

id:  t  rk_ ' nd ; 

pare u :  trklnk_ptr; 

Chi  Kt:  trk I nk_ptr  ;  ~~ 

numhvp:  integer; 
hyp:  (iyp.  set ; 
fptr :  l"k_ptr 
END 

{numhyp  is  the  number  of  hypotheses  jn  .hyp  ; 

fptr  points  to  next  track  in  list  of  act i ve~ Tracks] ; 

{  F  ND  ARCHITECTURE  OF  TRACK  UNIVERSE . ) 

th_store  I  ARRAY  [trk__ind]  OF  hyp_set; 

{Tempora'y  storage  for  fun.'tion  H*.  Used  in  hypothesis  and 
track  generation.  thstorelt]  empty  implies  track  t  does  not 
associate  with  input  in  procedure  hgen .  ) 

VAR 

trkloc:  'ARRAY  [trk_ind]  OF  Trk_ptr 

{used  for  direct  access  of  tract's.  trkloc[l]  is 

the  empty  track.  } 


Figure  A-l .  Track  and  hypothesis  structure  in  PASCAL.  Note  that  th-store  is  used  lor 
storing  H and.W 


PROCEDURE  hgen( thstore :  th  store; 

t  r'K  r  trk_ptrU - 

VAR 

trkout,  trK3!'  rrk_ptr! 
hind:  hyp_ind; 
tind:  trk_ind; 

~  hypnew?  “hVpJptf5;  " 

BEGIN  { hgen } 


{Associate  trk*  with  active  pretracks  in  thstore} 
FOR  tind  :  =  1  TO  trkmax  DO 

"IF  thstore 1 1 ' nd]  <>  {}  THEN  - 

BEGIN  {associations} 

IF"  lin’d  =  I  {empty  pretracKTYREN 
ti-kout  :=  trk 

ELSE 

BEGIN  {add  new  pretrack}" 

trkout  :=  gettrk; 

put parent ( trkout ,  trk); 

in.  t parent (trkout,  trkloctti hO] ) ; 

END  {add  new  pretrack}  ; 

{generate  resulting  hypotheses! 

FOR  hind  :  =  1  TO  hypmax  DO 

If  hind  IN  thstore[ t ind]  THEN 

CEG1N  - 


hypnew  : =  gethyp; 


add t rkh( trkout ,  hypnew); 

trk3‘  ‘.=  toptrk; 

WHILE  t rk3  <>  NIL  DO 
BEGIN 

~  IF  ( trk3  <:>  trLT6c[trne!)T  "SNIT  (hind  I N  ""trk"3"Th y p)  THEN 
addtrkh(trk3,  hypnew); 
trk3  :=  trk3*.fptr 

END;  - - - 


IF  tind  «  1  THEN 

.  add  t  r  kh  f  t  r  k  1  oc  ( ^  TrhypnewT 

END; _ _ _ 

END  {association}  ; 

‘  END  "fof  "TTgehy  7 - 


Figure  A-2.  PASCAL  code  for  HGEN.  External  procedures  are  PUTPARENT(A.B)  which 
links  pretrack  B  as  the  parent  of  preirack  A  .  ADDTRK(A.H)  which  adds  hypothesis  H  to 
the  set,W*(A)  associated  with  pretrack  A: GETTRK,  a  function  which  creates  a  pretrack 
whose  pointer  is  GETTRK;  GETHYP,  same  as  GETTRK  bui  creates  hypotheses. 
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APPENDIX  B:  A  MATHEMATICAL  FORMALISM 


This  appendix  develops,  very  briefly,  a  formal  probability  space,  which  provides  a 
precise  description  of  our  data  association  algorithm.  Within  this  context  the  quantities 
P(‘l‘)  which  appear  in  equations  (13H 15)  and  (24)  will  be  found  to  be  the  actual 
probabilities  of  the  objects  to  which  they  refer  (in  contrast  to  their  ultimate  role  as  ap¬ 
proximations  to  the  “real  world”).  Each  point  (or  event)  of  our  sample  space  is  a  set  of 
N  data  points  dj  along  with  a  partition  h  of  N  objects.  Executing  the  algorithm  on  a  given 
input  results  in  the  computation  of  probabilities  conditioned  on  various  subsets  of  the 
sample  space.  It  is  hoped  that  a  mathematical  description  will  help  to  clarify  questions 
concerning  the  internal  consistency  of  heuristic  procedures  and  their  consequences  and 
perhaps  serve  as  a  tool  in  their  design. 

Let  S  represent  the  possible  set  of  values  of  a  data  point;  i.e..  the  range  of  the  data 
functions  Dj  described  in  section  3.  Note  that  although  different  types  of  data  may  occur 
for  each  i.  by  a  suitable  choice  of  S  they  can  all  be  represented  as  points  in  a  common 
space.  For  example,  S  =  [ 0.2 7r )  ©  [0,<»).  where  ®  indicates  a  direct  sum.’*’  would  be  a 
suitable  representation  for  bearing  and  frequency  measurements.  Let  .fl(N  be  the  discrete 
space  whose  elements  h^  are  the  partitions  of  N  objects.  We  make  the  convention  that 
each  hN  contains  one  copy  of  the  null  set  0.  and  that  -  [0] .  Finally,  we  define  a 
sample  space  £2N  =  SN  X  where  SN  =  S  X  S  X  . . .  S.  the  Cartesian  product  of  S. 

N  times. 

Note  that  we  have  a  natural  surjection  from  £2n  to  r2m  for  nr  <  n  given  by 


.n.m 


(d, . dn,hn)  9 - ♦  (d, . dm,hm) 


(B-l ) 


where  hm  is  the  unique  partition  of  m  objects  such  that  hm  C  hn.  We  also  write  hm  -  hn 
and  use  the  expression  “hm  generates  h11”  in  the  spirit  of  equation  (3).  Following  (B-l ). 
we  take  the  liberty  to  write  hI1_1  =  q(hn)  and  (dj . dn_) )  =  q((d] . dn)). 

Furthermore,  let  us  assume  that  for  each  n  =  1 . N  and  for  each  point  ocn-*  in 

S2n~l  we  are  given  a  probability  measure  P  n_j(dn.hn)  on  the  subset  ( dn  .hn )  of  S  X.W'1 
satisfying  q ( h r* )  e  ccn_* .  Thus 


.  £  .  f 

I  hniq(hn)  e  con  Mvdn  G  S 


pwn-l(dn.hn)»l 


(B-2) 


Note  that  the  integral  is  meant  to  stand  for  the  appropriate  summing  operation  on  the 
space  S;  for  example.  Lebesque-Stiltjes  integration.  Clearly  P  n_|(dn.hn)  is  intended  to 

be  a  candidate  for  the  conditional  probability  P(dn.hnjcon-' )  =  P(d„.hnid| . dn_|.bn"' ). 

and  equation  (B-2)  corresponds  to  equation  (9). 


^Loosely  speaking,  the  points  of  A©  B  are  those  of  A  U  B.  with  ACA  UB  and  B  C  A  U  B  are  discon¬ 
nected  subsets  having  the  induced  topology. 
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To  retain  a  consistent  notation,  we  define 

dn  —  (d  j . dn)eSn  (B-3 

Note  that  dn  corresponds  to  3)  of  equation  (1 );  i.e..  it  is  the  set  of  all  “past”  data.  Finally, 
we  use  the  Bayesian  formula  to  motivate  a  recursive  definition  of  the  quantities  pdn<hn)- 
Namely, 

A  Pq(dn,hn)(dn’hn>  Pq(dn)(q(hn>) 

Pdn<hn>  =  - - 5—7^ - 


Pq(dn)(dn> 

P^n-l^n^n-l^11'1) 
Prin-1  (dn) 


for  hn~l  -*  h11 


where  P^n—  1  (dn)  is  determined  by  (B-4)  along  with  the  condition 

^  Pdn(hn)  =  1  (B-5 

all  h11 

(Note  that  P^h^)  =  1 .) 

We  easily  show  that 

P(dn)^Pd0(d1)Pdl(d2)...Pdn„1(dn)  (B-6 

is  a  probability  measure  on  Sn.  It  then  also  follows,  from  (B-5),  that  P  defined  by 

P(con)  =  Pdn(hn)P(dn)  (B-6 

where  a>n  =  (dn,hn)  is  a  probability  measure  on  J2n. 

More  precisely,  multiplying  (B-4)  by  Pdn-l(dnX  summing  over  hn.  and  using  (B-5), 
we  obtain 


Pdn-l(dn)  ^JPaJn-l(dn-hn)Pdn-l(cl^n^ 

hn 

Then  from  (B-2)  and  (B-5),  (B-8)  yields 

/  Pdn-|(dn)=  ^ 

J d„  un-1  lhn|q(hn)  =  hn 


,|  P^n-l^dn-h11)  Pdn-l(l,n  *) 
hn-l  |ydn  }hn|q(hn)  =  hn-l[  w  d 


-  2  I’Hn-lO'"-1) 
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It  follows  from  definition  (B-6)  that  j^n  P(dn)  =  1. 

Furthermore.  (B-7)  is  precisely  the  statement  that  P(dn)  is  the  measure  induced  on 
Sn  by  the  projection  mapping,  and  P^n(hn)  is  the  conditional  probability  of  hn:i.e„ 

P(hn|dn)  =  P  n(hn)  (B-l( 

Also,  (B-6)  implies  that  P^n_i(dn)  is  the  conditional  probability  of  dir  where  the  event 
dn~^  is  the  set  of  all  (dn,hn)  such  that  q(dn)  =  dn~' .  Thus 

P(dnldn'1)  =  Pdn_1(dn)  (B-ll 

Finally,  by  (B-6)  and  then  (B-4)  with  (B-10) 

p(dn.h",d"->.h"->, — wrtisi?) 

P(hn-1|dn"  )P(dn_1) 

P(hn|dn)Pdll_1(dn) 

P(hn_1!dn_1) 

^n-|Wnh">l>dn-l(Hn~'> 

P(hn-1|dn_1) 


=  P  n-i^.h11)  <B-1; 

GJ 

so  that  the  quantities  P  n_i  (dn.hn)  have  exactly  the  desired  interpretation  with  respect  to 
co  11 

the  probability  space  (J2n.P), 

We  remark  that  if  modeling  considerations  make  it  expedient  to  further  decompose 

the  probability  structure  by  supplying  two  probabilities  P  n  i  n(dn)  and  P  n_i(hn)in 

d  ,h  cc 

place  of  P  n  i(dn.hn)  (see  section  4),  then  the  above  computations  generalize  to  yield 
co  1 

P(dnldn-1.hn)  =  P  n_j  lin(dn)  and  P(hnjdn_1  ,hI1_^)  =  P  n_j(hn).  We  merely  replace 

P  _  | (dn,hn)  in  the  recursive  definition  (B-4)  by  P  n_i  „(dn)P  n_i(hn).  Note  that 
to1  1  “  d  1  ,h  11  u>  1 

in  this  case  the  given  quantities  P  n_j  n(dn)  and  P  n_j(hn),  since  they  are  assumed  to 

d  ,h  co 

be  probability  measures,  must  satisfy 


f  Pdn-lhn<V=  1  and 


E  P„_l<hn)«l 
Jhniq(hn)  €  con_1 1 


in  lieu  of  equation  (B-2). 


The  space  (S2.P)  immediately  gives  us  some  insight  into  the  algorithm.  We  find  that, 
even  in  the  absence  of  pruning,  the  conditional  probabilities  P(hn|dn)  will  in  general  depend 
on  the  ordering  of  the  data  dj.  More  precisely,  let  us  define  random  variables  Dn  and  Hn  on 
nn  by 


Dn(cc)  =  (d  j . dn) 


(B-15) 


Hn(to)  =  hn 
where  co  =  (dn,hn) 

Then  P(Hn  =  hn|Dn  =  (d|.  d->  ....  dn)),  which  equals  P(hnidn).  is  generally  different  from 

P(Hn  =  h'n|Dn  =  (di,  d  j . dn))  which  in  turn  differs  from  the  probability  conditioned 

on  any  other  ordering  of  these  values  d;.+  This  is  true  because  the  P(hn,dn)  are  defined 

*  n 

(cf.  equation  (B-4)  1  in  terms  of  the  quantities  P  p_i(de,h*)  for  £  <  n  which  are  typically 
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determined  by  physical  models  and/heuristic  considerations.  There  is  no  reason  to  expect 
that  such  models  would  satisfy  the  necessary  mathematical  relations  to  ensure  equality  of 
the  above  expressions.  For  example,  for  £  =  2  the  equality  P(H"  =  h"|D“  =  (d|  ,d->)  = 
P(h'“|D"  =  (dT.dj ))  would  require  that  P(dj  ,h')(d2’h“)pd  j  ^Pd'^d2)  = 

P(dT  h'  •  )(dj  ,h '^)pd^(h  ^7pd-,^dl)  tor  values  of  dj  and  d->. 

Simply  put,  each  point  cjn  €  corresponds  to  a  unique  sequence  of  data  points 

d  j . dn.  The  probabilities  conditioned  on  a  particular  sequence  correspond  to  the 

results  of  applying  the  data  association  algorithm  to  those  measurements  in  the  indicated 
order.  Different  orderings  correspond  to  different  subspaces  of  (recall  that 
ojn  =  (dn.hn)  so  that  conditioning  on  dn  leads  to  the  subspace  of  £2n  which  may  loosely 
be  described  as  all  partitions  hn  of  the  data  sequence  dn)  and  in  general  lead  to  different 
probabilities.  Note  that  these  considerations  are  wholly  independent  of  the  temporal 
order  of  the  measurements:  they  only  refer  to  the  processing  order  of  the  algorithm.  For 
example,  in  the  case  of  bearing  measurements  we  might  have  Dj  =  (0  =  1 .5°  at  time  = 

22  minutes)  and  Di  =  (0  =  3.1°  at  time  =  40  minutes).  Alternatively,  these  could  be 
D|  =  (0  =  3.1°  at  time  =  40  minutes)  and  D->  =  (0  =  1 .5°  at  time  =  22  minutes):  the 
physical  data  are  exactly  the  same,  only  the  order  in  which  it  is  input  to  the  algorithm 
has  been  changed.  It  is  clear  that  since  the  physical  situation  is  independent  of  such 
orderings,  a  perfect  algorithm  would  also  exhibit  that  independence.  However,  it  is  not 
clear  that  demanding  order  invariance  would  lead  us  to  develop  a  better  algorithm.  Cer¬ 
tainly  in  all  but  the  simplest  situations  it  would  involve  giving  up  the  (to  us,  essential) 
computational  advantages  of  the  recursive  approach.  Regardless,  we  note  that  trying 
different  orderings  of  the  data  and  comparing  results  is  one  possible  avenue  for  examining 
the  interna]  consistency  and  implications  of  our  modeling  efforts. 


+By  h,n  we  mean  the  unique  partition  of  integers  whieli  when  applied  to  d-,.  dj  ...  d()  leads  to  the  same 
sets  of  data  points  as  the  partition  hn  applied  to  d j .  d^ . dn 
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We  also  remark  on  the  relationship  between  pruning  and  the  probability  space  ft11. 
The  pruning  operation  removes  certain  partitions  from  consideration.  In  terms  of  scoring, 
a  pruned  hypothesis  h  is  given  a  probability  of  zero  and  the  scores  of  the  remaining 

hypotheses  are  computed  by  renormalizing  so  that  P(h')  =  1 .  This  is  equivalent  to 

h  =£h 

replacing  P(h')  by  P(h'|h'^h)  since  Pfh'th'^h)  =  P(h')/(1  -  P(h))  where  the  denominator 
is  completely  determined  by  the  normalization  condition.  Thus  our  final  results,  the  scores 
of  h'n  given  dn,  may  be  interpreted  as  the  probabilities  of  h'n  given  dn  and  given  the 
prunings  which  occurred. 

In  a  sense,  this  means  we  are  “leaking”  probability;  i.e.,  we  ignore  events  corres¬ 
ponding  to  the  pruned  hypotheses  even  though  they  have  a  non-zero  probability.  In  fact, 
suppose  that  at  some  stage  we  prune  a  hypothesis  which  has  probability  P(h)  satisfying 

0  <  r  =  P(h)  <  1 .  Then  P(h')  =  1  -  r;  i.e.,  the  total  probability  of  the  events  now  under 

h  ^h 

consideration  is  reduced  through  multiplication  by  a  factor  of  1  -  r,  and  the  algorithm  has 
effectively  lost  a  set  of  probability  r.  If  this  is  repeated  at  M  different  stages,  then  the  set  of 
hypotheses  under  consideration  will  have  a  total  probability  of  only  ( 1  -  r)M  and  the  pruned 
hypotheses  of  1  -  ( l-r)M.  One  may  well  speculate  on  the  fact  that  as  M  -  °°,  the  set  of 
events  under  scrutiny  has  vanishing  probability!  Such  paradoxes  may  be  avoided  by  window 
ing  the  data  and  thus  effectively  limiting  M.  Note  that  if  desired,  one  may  very  easily  keep 
track  of  the  quantity  of  probability  which  has  been  “lost”;  however,  keeping  count  of  the 
number  of  separate  hypotheses  which  would  have  been  generated  by  the  pruned  hypotheses 
is  not  generally  computationally  feasible. 
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APPENDIX  C:  NOTES  ON  MODELING  APPROXIMATIONS 


The  Pretrack  Density  aj(x|h',0') 

Our  use  in  section  4.2  of  a  pretrack  state  density  which  is  hypothesis  independent  is 
an  approximation  which  is  actually  inconsistent  with  most  physical  situations.  Generally, 
the  probability  of  the  state  of  a  pretrack  is  a  function  of  the  hypothesis  in  which  it  is  in¬ 
cluded;  and,  hence,  <*j(x)  is  more  correctly  modeled  as  ajfxih),  a  different  density  for  each 
hypothesis  which  contains  the  pretrack  Tj.  In  fact,  for  j  =£  k  but  Tj  €  h^  where  h  -*  h^ 

P(h'.  ,0',Xj) 

aj(xj|hk-0  ’  ~  P(hk.0') 

^ajfXjlh). 

Thus,  the  inclusion  of  pretrack  Tj  in  hypothesis  h^  implies  that  its  state  density  conditioned 
on  the  past  data  must  be  updated*  under  h  ■*  h'k  even  though  the  pretrack  itself  is  unaltered. 
Ignoring  this  fact  is  equivalent  to  assuming  that  the  measurement  and  association  of  O'  with 
Tk  gives  no  information  concerning  the  location  of  Tj.  This  is  incorrect  since  knowing  that 
0'  did  not  come  from  Tj  does  carry  implications  concerning  T:’s  state.  Furthermore,  it 
is  usually  a  function  of  k;  i.e.,  we  find  that  aj(*jlhk)  ^  <*j(Xj|hg)  for  k  ^  2.  However,  from 
a  practical  viewpoint,  the  approximation  of  these  densities  by  a  single  state  density  per  pre¬ 
track  is  necessary  both  to  avoid  an  unreasonable  number  of  states  (#.#*(T)  for  each 
pretrack  T)  and  to  overcome  an  inability  to  compute  P(hjc,0'.Xj). 

A  systematic  treatment  leads  us  back  to  equation  (29).  We  find  that  we  need  a 
more  detailed  model;  i.e.,  expressions  forP(hj|X],  ....  xn)  rather  than  just  P(hj|Xj).  A  natural 

choice  still  would  be  to  specify  that  P(hjix  j . xn)  be  proportional  to  0j(Xj)  =  Pfdetect  Tj  Ixj) 

This  implies 

P(h]|x,,x2 . xn)  =  cX]iX2,  ...  xn0j(xj)  where 

cx, . xn  =  |S/3j(xj)  +  ^h(NT>  +  Th(FA>J 

(In  a  really  complete  model,  7h(NT)  and  7h(FA)  must  also  include  a  dependency  on 
xj . xn.)  We  then  find  that 

P(hj,0',xk)=  j  P(0'(hjXj)P(hj|Xj,  ...,  xn)  a  j(xj)  ...a^(x£)  ...  otn(xn)dX]  ...dx^  ...  dx, 

where  the  circumflex  indicates  the  absence  of  integration  over  ak(xk)dxk.  Clearly,  the 
computational  burden  is  unmanageable  even  if  the  functions  are  discretized  over  a  finite 
number  of  regions. 


^At  the  next  stage  h^,  O'  become  past  data. 


Note  also  that  due  to  the 


1  ’  •  xn 


p(hj)  =  f  p(hjlxi,  ...,xn)oj(xj)  ...an(xn)dx]  ...  dxn 


is  not  necessarily  proportional  to  J j3j(Xj)aj(Xj)dXj  so  that  equation  (28)  of  section  4.2  is  an 

approximation  which  is  also  “inconsistent  with  reality.”  However,  P(h')  of  (28)  does  take 
into  account  the  possibility  that  Q'  belongs  to  some  other  track  Tk  through  the  normaliza¬ 
tion  (50)-(51). 

Estimating  7h(NT),  7h<FA).  and  Ph(t') 

Suppose  that  we  have  access  to  the  following  parameters: 

NTOT  =  average  number  of  targets  in  the  surveillance  area 

Ap  =  average  false  alarm  rate  when  no  targets  are  in  the  surveillance  area 

XD  =  average  detection  rate  when  a  single  target  is  in  the  surveillance  area 
(including  the  possibility  it  is  not  in  a  CZ) 

and  J  =  number  of  pretracks  in  the  hypothesis  h  under  consideration 

We  model  the  probability  of  a  single  (possibly  false)  “detection”  within  a  time  interval 
At  by  a  Poisson  distribution^ 


PA=  (AtAA)e 


-AAAt 


where 


Aa  =  AF  +  (NTOT)Ad  ( 

is  the  average  alarm  rate  (i.e.,  FA’s  and  detections)  for  NTOT  targets  in  the  surveillance 
area.  It  follows  that  the  probability  of  a  single  false  alarm  and  of  a  single  new  target 
detection  are,  respectively. 


P(FA)  =  (AtAp)e 


-AAAt 


-AA4t 


P(NT)  =  (NTOT-J)+(AtAD)e  A 

when  NTOT  targets  are  present.  We  have  used  the  notation  x+  =  x  if  x  >  0,  and 
x+  =  0  if  x  <  0. 


^(FA)  =  (prob  of  FA/alarm) 

=  (prob  of  FA)/prob  (alarm) 
=  Ap/AA 


^P(no  alarm  in  [0,At))  =  lim  (1  -  6A^)At^  =  e  A  .  Then  P(first  alarm  at  At)  =  (AtA^)e  A 
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since  the  event  FA  presupposes  an  alarm  and  hence  is  equivalent  to  "FA  and  alarm.” 
Similarly 

7h(NT)  =  (NT0T-J)+(XD/XA)  (C-6) 

Note  that  (C-5)  and  C-6)  may  be  rewritten  as 

VFA>=rbr 

( 1  -  J/NTOT)+ 

7h(NT)  = - : -  (C-7) 

1+lf1 

where  tj  =  (NTOT)(X[)/Xp)  and  thus  depends  only  on  (X^/Xp):  i.e.,  we  only  have  to  estimate 
the  ratio  of  the  rates.  On  the  other  hand,  it  is  not  correct  to  assign  the  same  rate  Xp  to  the 
J  pretracks  known  to  be  present  (under  hypothesis  h)  as  to  the  other  (NTOT-J )+  presumed 
present.  This  is  true  because  -y^NT)  and  7h(FA)  are  conditioned  on  the  hypothesis  h 
which  may  contain  information  concerning  the  position  and/or  signal  levels  of  its  pretracks 
which  should  influence  the  probability  of  such  a  detection.  In  fact,  the  7j  =  c^tj  of  (51) 
are  clearly  functions  of  j,  even  though  they  correspond  to  the  probability  of  a  detection 
from  target  j  given  an  alarm  which,  under  the  above  construction,  would  have  been  a  con¬ 
stant,  Xq/Xa.  Nevertheless,  the  above  expressions  are  consistent  on  the  average  since 

7j  =  J(Xp/XA)  (both  sides  are  equal  to  1  -  ^(NT)  -  ^(FA)).  We  have  simply  used 

two  different  levels  of  physical  approximations,  one  to  estimate  the  sum  ^7j  via  an 

average  value  for  7;  namely,  X-p/Xp;  the  other  to  determine  the  fine  structure  of  the 
Tj’s  by  estimating  their  relative  sizes  7j  and  then  normalizing  via  c^. 

We  might  wish  to  modify  the  above  so  that  P(NT)  is  not  zero  when  J  >  NTOT 
since  statistical  fluctuations  will  lead  to  pretracks  which  do  not  correspond  to  targets 
so  that  NTOT  pretracks  do  not  imply  all  targets  have  been  detected.  Furthermore,  a 
cut-off  of  the  type  found  in  (C-4)  produces  biased  results;  i.e..  the  average  number 
(over  an  ensemble  of  experiments)  of  pretracks  in  the  highest  scoring  hypotheses  will 
be  less  than  NTOT.  Probably  the  most  reasonable  approach  is  to  assign  a  distribution 
P(NTOT)  to  NTOT  and  replace  equation  (C-7)  by  its  "expectation"  (i.e.,  set 

7u(FA)=  7n(FA,  NTOT) P(NTOT)  and  similarly  for  7^(NT)).  Alternatively,  we 

NTOT 

can  retain  (C-4)  and  interpret  NTOT  as  a  system  cut-off  (i.e..  point  of  saturation)  rather 
than  the  true  statistical  expectation  for  the  number  of  targets  in  the  surveillance  area. 

Note  that  in  this  particular  model  the  timing  information  is  of  limited  value.  It 
only  serves  to  estimate  XA  (via  equation  (C-l ) )  which  does  not  supply  any  data  association 
information.  At  least  this  is  true  for  our  current  model  in  which  the  P^t'-t)  =  At)  = 

P( first  alarm  at  At)  =  (AtXA)e-^AAt  which  is  independent  of  h.  However.  At  does  furnish 
a  crude  means  of  estimating  r\  if  Xp  is  known,  or  NTOT  if  Xp  and  Xp  are  known. 
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